benchmarks.bio

Therapeutics · Capabilities

TxBench-Oligo-Discovery results

Agentic benchmark tasks for oligonucleotide discovery and development decisions.

Published score: Full benchmark (113 evaluations) · short horizon · data updated 2026-10-09

This page reports published TxBench-Oligo-Discovery scores from benchmarks.bio. TxBench-Oligo-Discovery contains 113 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published TxBench-Oligo-Discovery scores
RankModelHarnessProviderScore
1GPT-6 AstraCodexOpenAI55.5%
2GPT-6 AstraPiOpenAI53.4%
3Claude Opus 5Claude CodeAnthropic48.1%
4Grok 4.6PiSpaceXAI44.0%
5Grok 4.6Grok BuildSpaceXAI42.8%
6Claude Opus 5PiAnthropic42.2%
7Claude Opus 4.8Claude CodeAnthropic39.9%
8Gemini 3.7 FlashPiGoogle39.5%
9Claude Opus 4.8PiAnthropic39.4%
10Claude Sonnet 5Claude CodeAnthropic39.3%
11Gemini 3.5 FlashPiGoogle38.6%
12Grok 4.5PiSpaceXAI38.4%
13GPT-5.6 SolCodexOpenAI34.5%
14DeepSeek V4.1 FlashPiDeepSeek33.9%
15GPT-5.5PiOpenAI33.6%
16GPT-5.6 TerraPiOpenAI33.3%
17GPT-5.6 TerraCodexOpenAI32.5%
18GPT-5.5CodexOpenAI30.4%
19GPT-5.6 LunaCodexOpenAI23.9%
20GPT-5.6 LunaPiOpenAI23.3%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.