benchmarks.bio

Therapeutics · Capabilities

TxBench-Oligo-Discovery results

Agentic benchmark tasks for oligonucleotide discovery and development decisions.

Published score: Current V1 evaluation set (113 evaluations) · short horizon · data updated 2026-11-05

This page reports published TxBench-Oligo-Discovery scores from benchmarks.bio. TxBench-Oligo-Discovery contains 113 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published TxBench-Oligo-Discovery scores
RankModelHarnessProviderScoreVariant
1Claude Opus 5.5*Claude CodeAnthropic62.2%LSVP
2Claude Opus 5.5*PiAnthropic59.9%LSVP
3Claude Fable 5.1*PiAnthropic54.9%LSVP
4GPT-6.1 SolPiOpenAI52.5%
5Claude Sonnet 5.5Claude CodeAnthropic51.9%
6Claude Sonnet 5.5PiAnthropic51.9%
7GPT-6 AstraPiOpenAI51.9%
8Gemini 4 ArgonPiGoogle51.0%
9GPT-6 AstraCodexOpenAI50.7%
10GPT-6.1 SolCodexOpenAI49.6%
11Claude Opus 5Claude CodeAnthropic48.4%
12Grok 4.6PiSpaceXAI46.0%
13Grok 4.6Grok BuildSpaceXAI44.3%
14GPT-6 SolPiOpenAI43.1%
15Claude Opus 5PiAnthropic42.5%
16Grok 4.7PiSpaceXAI41.9%
17Gemini 3.7 FlashPiGoogle37.8%
18Claude Opus 4.8PiAnthropic37.5%
19GPT-5.6 SolCodexOpenAI37.2%
20Claude Sonnet 5PiAnthropic36.6%
21Claude Opus 4.8Claude CodeAnthropic36.0%
22GPT-5.6 SolPiOpenAI36.0%
23Gemini 3.8 FlashPiGoogle35.1%
24DeepSeek V4.1 FlashPiDeepSeek34.8%
25Claude Sonnet 5Claude CodeAnthropic33.9%
26GPT-5.5PiOpenAI33.9%
27GPT-6 LunaPiOpenAI33.6%
28Claude Opus 4.7PiAnthropic31.9%
29GLM 5.3PiZ.ai31.9%
30Claude Opus 4.7Claude CodeAnthropic31.3%
31Kimi K3PiMoonshot31.3%
32GPT-6.1 TerraPiOpenAI30.4%
33Claude Sonnet 4.6PiAnthropic30.1%
34GPT-6.1 TerraCodexOpenAI28.3%
35Claude Sonnet 4.6Claude CodeAnthropic28.0%
36Beam 1.0PiReflection27.4%
37Mistral Large 4.0PiMistral27.1%
38Nemotron 3 Ultra 550B A55BPiNVIDIA25.1%
39GPT-5.6 LunaCodexOpenAI23.0%
40GPT-5.6 LunaPiOpenAI23.0%
41Nemotron 3.5 LightningPiNVIDIA8.6%
42Claude Opus 5.5PiAnthropic1.5%
43Claude Opus 5.5Claude CodeAnthropic1.2%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.

LSVP: Anthropic's safety-filter-exempt evaluation variant, which produces fewer refusals on biology prompts. LSVP results are reported alongside the model's standard run and are not a replacement for it.