benchmarks.bio

Therapeutics · Capabilities

TxBench-Antibody-Development results

Tests whether AI agents can make the evidence-based decisions that take a therapeutic antibody from a chosen candidate to its first dose in people, such as whether it can be made and stored reliably, whether a manufacturing change altered the drug, or what starting dose is safe.

Published score: Current V1 evaluation set (60 evaluations) · short horizon · data updated 2026-10-30

This page reports published TxBench-Antibody-Development scores from benchmarks.bio. TxBench-Antibody-Development contains 60 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published TxBench-Antibody-Development scores
RankModelHarnessProviderScoreVariant
1Grok 4.7Grok BuildSpaceXAI39.4%
2Claude Opus 5*Claude CodeAnthropic37.2%LSVP
3Claude Sonnet 5.5PiAnthropic36.7%
4Grok 4.7PiSpaceXAI36.1%
5Claude Sonnet 5.5Claude CodeAnthropic34.4%
6Claude Opus 5.5*PiAnthropic32.8%LSVP
7Claude Opus 5.5*Claude CodeAnthropic32.8%LSVP
8GPT-6 AstraPiOpenAI32.8%
9Gemini 4 ArgonPiGoogle31.1%
10GPT-6 AstraCodexOpenAI31.1%
11Claude Opus 5*PiAnthropic30.0%LSVP
12Grok 4.6Grok BuildSpaceXAI28.3%
13Claude Fable 5.1PiAnthropic27.8%
14GPT-6.1 SolCodexOpenAI27.8%
15Claude Fable 5.1Claude CodeAnthropic26.9%
16GPT-6.1 SolPiOpenAI26.7%
17Grok 4.6PiSpaceXAI26.1%
18GPT-6.1 TerraCodexOpenAI22.8%
19GPT-6.1 TerraPiOpenAI22.2%
20GPT-5.6 SolPiOpenAI18.9%
21GPT-6 LunaCodexOpenAI18.9%
22GPT-6 LunaPiOpenAI16.1%
23Gemini 3.8 FlashPiGoogle15.0%
24DeepSeek V4.1 FlashPiDeepSeek14.4%
25Claude Sonnet 5PiAnthropic13.3%
26GPT-5.6 SolCodexOpenAI12.2%
27Claude Sonnet 5Claude CodeAnthropic11.1%
28GLM 5.3PiZ.ai10.0%
29Kimi K3PiMoonshot6.1%
30Mistral Large 4.0PiMistral6.1%
31Nemotron 3 Ultra 550B A55BPiNVIDIA5.6%
32GPT-5.6 LunaPiOpenAI5.0%
33Nemotron 3.5 LightningPiNVIDIA4.4%
34GPT-5.6 LunaCodexOpenAI2.8%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Repository for task construction, grading, aggregation, and uncertainty details.

LSVP: Anthropic's safety-filter-exempt evaluation variant, which produces fewer refusals on biology prompts. LSVP results are reported alongside the model's standard run and are not a replacement for it.