benchmarks.bio publishes agentic AI benchmark results across three domains: omics, therapeutics, and biosecurity. Every benchmark is built from a snapshot of real experimental data captured immediately before a target analysis step, paired with a deterministic grader that checks whether an agent recovered the actual biological result rather than whether it produced plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. The overall score in the table below is the equally weighted mean of a configuration's observed scores across the 13 capability benchmarks; a missing benchmark score is excluded from that mean and is never counted as zero. V0 and V1 cover different evaluation sets and should not be read as a single time series.
| Rank | Model | Harness | Provider | Overall score |
|---|---|---|---|---|
| 1 | GPT-6 Astra | Pi | OpenAI | 48.7% |
| 2 | GPT-6 Astra | Codex | OpenAI | 48.5% |
| 3 | Claude Opus 5 | Claude Code | Anthropic | 48.0% |
| 4 | Claude Opus 5 | Pi | Anthropic | 48.0% |
| 5 | Claude Sonnet 5.5 | Claude Code | Anthropic | 46.0% |
| 6 | Grok 4.6 | Grok Build | SpaceXAI | 45.4% |
| 7 | Claude Sonnet 5.5 | Pi | Anthropic | 44.7% |
| 8 | GPT-5.6 Sol | Pi | OpenAI | 43.4% |
| 9 | Gemini 3.8 Flash | Pi | 43.4% | |
| 10 | Claude Opus 4.8 | Pi | Anthropic | 42.7% |
| 11 | GPT-5.6 Terra | Pi | OpenAI | 42.4% |
| 12 | Grok 4.6 | Pi | SpaceXAI | 42.3% |
| 13 | GPT-5.6 Sol | Codex | OpenAI | 41.8% |
| 14 | Gemini 3.5 Flash | Pi | 41.7% | |
| 15 | DeepSeek V4.1 Flash | Pi | DeepSeek | 41.6% |
| 16 | GPT-5.6 Terra | Codex | OpenAI | 41.5% |
| 17 | Grok 4.5 | Pi | SpaceXAI | 41.3% |
| 18 | Claude Opus 4.8 | Claude Code | Anthropic | 41.1% |
| 19 | Claude Opus 5.5 | Claude Code | Anthropic | 40.5% |
| 20 | Claude Opus 4.7 | Claude Code | Anthropic | 39.8% |
| 21 | GPT-5.5 | Codex | OpenAI | 38.7% |
| 22 | GPT-5.5 | Pi | OpenAI | 37.8% |
| 23 | Claude Sonnet 5 | Pi | Anthropic | 37.5% |
| 24 | Claude Sonnet 5 | Claude Code | Anthropic | 37.0% |
| 25 | Gemini 3.7 Flash | Pi | 36.5% | |
| 26 | Kimi K3 | Pi | Moonshot | 35.3% |
| 27 | Claude Opus 5.5 | Pi | Anthropic | 34.3% |
| 28 | Grok 4.7 | Grok Build | SpaceXAI | 33.7% |
| 29 | Grok 4.7 | Pi | SpaceXAI | 33.5% |
| 30 | GPT-5.6 Luna | Pi | OpenAI | 31.0% |
| 31 | GPT-6 Sol | Codex | OpenAI | 30.4% |
| 32 | GPT-6 Sol | Pi | OpenAI | 30.3% |
| 33 | GPT-5.6 Luna | Codex | OpenAI | 29.7% |
| 34 | GPT-6 Luna | Codex | OpenAI | 23.5% |
| 35 | Claude Sonnet 4.6 | Pi | Anthropic | 22.3% |
| 36 | GPT-6 Luna | Pi | OpenAI | 21.4% |
| 37 | Claude Sonnet 4.6 | Claude Code | Anthropic | 16.8% |
Included benchmarks
- SpatialBench — Omics; published score: Verified subset (115 evaluations); Full benchmark: 159 evaluations
- SpatialBench-Long — Omics; published score: Verified subset (22 evaluations); Full benchmark: 24 evaluations
- scBench — Omics; published score: Full benchmark (195 evaluations)
- scBench-Long — Omics; published score: Verified merged subset (22 evaluations); Original full release: 21 evaluations
- EpiBench — Omics; published score: Full benchmark (106 evaluations)
- VariantBench — Omics; published score: Full benchmark (118 evaluations)
- MetagenomicsBench — Omics; published score: Full benchmark (100 evaluations)
- TxBench-Antibody-Discovery — Therapeutics; published score: Full benchmark (100 evaluations)
- TxBench-Preclinical-Pharmacology — Therapeutics; published score: Full benchmark (100 evaluations)
- TxBench-Oligo-Discovery — Therapeutics; published score: Full benchmark (113 evaluations)
- BioSecBench-Surveillance — Biosecurity; published score: Full benchmark (102 evaluations)
- BioSecBench-Refusal — Biosecurity; published score: Full benchmark (107 evaluations)
- BioSecBench-Function — Biosecurity; published score: Full benchmark (111 evaluations)
- OncologyBench — Applications; published score: Selected release (strict task and decision pass) (25 evaluations)