benchmarks.bio

Therapeutics · Capabilities

TxBench-Preclinical-Pharmacology results

Agentic benchmark tasks for preclinical pharmacology analysis and decision-making.

Published score: Full benchmark (100 evaluations) · short horizon · data updated 2026-10-09

This page reports published TxBench-Preclinical-Pharmacology scores from benchmarks.bio. TxBench-Preclinical-Pharmacology contains 100 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published TxBench-Preclinical-Pharmacology scores
RankModelHarnessProviderScore
1Claude Opus 5Claude CodeAnthropic68.7%
2Gemini 3.8 FlashPiGoogle66.0%
3Grok 4.6Grok BuildSpaceXAI64.7%
4Claude Opus 5PiAnthropic63.3%
5Grok 4.6PiSpaceXAI62.0%
6GPT-5.6 SolPiOpenAI61.7%
7GPT-6 AstraCodexOpenAI61.7%
8GPT-6 AstraPiOpenAI60.3%
9Claude Opus 4.8PiAnthropic59.3%
10GPT-5.6 SolCodexOpenAI59.0%
11Grok 4.5PiSpaceXAI57.7%
12GPT-5.5PiOpenAI55.3%
13Claude Opus 4.8Claude CodeAnthropic54.7%
14DeepSeek V4.1 FlashPiDeepSeek54.3%
15GPT-5.6 TerraPiOpenAI54.0%
16GPT-5.6 TerraCodexOpenAI51.7%
17Gemini 3.5 FlashPiGoogle51.3%
18Claude Opus 4.7PiAnthropic49.3%
19Claude Sonnet 5Claude CodeAnthropic48.3%
20GPT-5.5CodexOpenAI47.3%
21GPT-5.6 LunaPiOpenAI46.7%
22Kimi K3PiMoonshot44.7%
23Claude Opus 4.7Claude CodeAnthropic44.0%
24Claude Sonnet 5PiAnthropic42.0%
25GPT-5.6 LunaCodexOpenAI42.0%
26Claude Sonnet 4.6PiAnthropic36.0%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.