benchmarks.bio

Applications · Capabilities

OncologyBench results

OncologyBench tests whether AI agents can translate cancer research into real-world decisions about detection, diagnosis, treatment, and research priorities. Separate agents complete analytical tasks, and a final agent synthesizes their findings into a decision. Strict scores require full marks on both tasks and decisions across the selected 25 evaluations; refusals and timed-out slots remain in the denominator.

Published score: Selected release (strict task and decision pass) (25 evaluations) · long horizon · data updated 2026-10-09

This page reports published OncologyBench scores from benchmarks.bio. OncologyBench contains 25 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published OncologyBench scores
RankModelHarnessProviderScore
1Claude Opus 5PiAnthropic40.0%
2Claude Opus 5.5Claude CodeAnthropic37.3%
3Claude Opus 5Claude CodeAnthropic36.0%
4Claude Sonnet 5.5Claude CodeAnthropic32.0%
5Claude Sonnet 5.5PiAnthropic29.3%
6Claude Opus 5.5PiAnthropic29.3%
7Kimi K3PiMoonshot24.0%
8GPT-6 AstraPiOpenAI21.3%
9GPT-6 SolCodexOpenAI20.0%
10GPT-5.6 SolPiOpenAI18.7%
11GPT-6 AstraCodexOpenAI18.7%
12Grok 4.6PiSpaceXAI18.7%
13GPT-6 SolPiOpenAI18.7%
14Grok 4.7Grok BuildSpaceXAI18.7%
15Grok 4.7PiSpaceXAI18.7%
16Grok 4.6Grok BuildSpaceXAI17.3%
17Claude Opus 4.8Claude CodeAnthropic16.0%
18Claude Opus 4.8PiAnthropic16.0%
19GPT-6 LunaCodexOpenAI16.0%
20Claude Sonnet 5PiAnthropic14.7%
21DeepSeek V4.1 FlashPiDeepSeek14.7%
22GPT-5.5PiOpenAI14.7%
23GPT-5.6 SolCodexOpenAI14.7%
24Gemini 3.7 FlashPiGoogle14.7%
25Gemini 3.8 FlashPiGoogle13.3%
26Claude Sonnet 5Claude CodeAnthropic12.0%
27GPT-6 LunaPiOpenAI12.0%
28GPT-5.6 LunaCodexOpenAI10.7%
29GPT-5.6 LunaPiOpenAI10.7%
30Claude Sonnet 4.6Claude CodeAnthropic5.3%
31Claude Sonnet 4.6PiAnthropic2.7%

Methodology and provenance

Scores use a 0–100 percentage scale. Publication links are not yet available.