benchmarks.bio

Omics · Capabilities

scBench-Long results

Long-horizon single-cell analysis tasks requiring sustained empirical work and biological reasoning.

Published score: Verified merged subset (22 evaluations); Original full release: 21 evaluations · long horizon · data updated 2026-10-09

This page reports published scBench-Long scores from benchmarks.bio. scBench-Long contains 21 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published scBench-Long scores
RankModelHarnessProviderScore
1GPT-5.6 SolCodexOpenAI43.9%
2GPT-6 AstraCodexOpenAI42.4%
3GPT-5.6 SolPiOpenAI40.9%
4GPT-6 AstraPiOpenAI39.4%
5Claude Opus 5PiAnthropic36.4%
6GPT-5.6 TerraPiOpenAI34.9%
7GPT-5.6 TerraCodexOpenAI31.8%
8Claude Opus 5Claude CodeAnthropic30.3%
9GPT-5.6 LunaPiOpenAI28.8%
10DeepSeek V4.1 FlashPiDeepSeek27.3%
11Grok 4.6Grok BuildSpaceXAI27.3%
12Claude Opus 4.8PiAnthropic25.8%
13Grok 4.5PiSpaceXAI25.8%
14Gemini 3.5 FlashPiGoogle24.2%
15Grok 4.6PiSpaceXAI24.2%
16Gemini 3.7 FlashPiGoogle24.2%
17GPT-5.5PiOpenAI22.7%
18Claude Opus 4.8Claude CodeAnthropic21.2%
19Claude Sonnet 5PiAnthropic19.7%
20Claude Sonnet 5Claude CodeAnthropic16.7%
21Kimi K3PiMoonshot16.7%
22GPT-5.5CodexOpenAI16.7%
23GPT-5.6 LunaCodexOpenAI12.1%
24Claude Opus 4.7Claude CodeAnthropic10.6%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.