benchmarks.bio

Omics · Capabilities

SpatialBench-Long results

Long-horizon agentic analysis of spatial biology datasets requiring multi-step biological reasoning.

Published score: Current V1 evaluation set (21 evaluations) · long horizon · data updated 2026-11-13 (November 13, 2026)

Compare current model-and-harness results for SpatialBench-Long. Long-horizon agentic analysis of spatial biology datasets requiring multi-step biological reasoning. Current V1 covers 21 evaluations and 44 ranked configurations. Data updated 2026-11-13. The highest-ranked published configurations are Claude Opus 5.5* (Claude Code, LSVP, 40.5%); GPT-6.1 Terra (Pi, 40.5%); GPT-6.1 Sol (Codex, 39.9%). The highest-ranked published run without an LSVP exemption is GPT-6.1 Terra (Pi, 40.5%). Scores report benchmark-specific biological task performance on a 0–100 percentage scale. See the linked paper and repository for task construction, grading and uncertainty methodology. Results describe the complete model and agent harness used for each run, and are not comparable across different benchmarks or evaluation versions.

Original study and current evaluation set

The original SpatialBench-Long study reports 24 evaluations. This leaderboard reports the current V1 evaluation set of 21 evaluations. These are separately scoped releases. Use the current V1 set when citing this table and the original study when citing its historical results. Score comparisons require the same evaluation version and scoring rules. Original study.

Published SpatialBench-Long scores
RankModelHarnessProviderScoreVariant
1Claude Opus 5.5*Claude CodeAnthropic40.5%LSVP
2GPT-6.1 TerraPiOpenAI40.5%
3GPT-6.1 SolCodexOpenAI39.9%
4Claude Opus 5.5*PiAnthropic39.3%LSVP
5GPT-6 AstraCodexOpenAI39.3%
6GPT-6.1 TerraCodexOpenAI39.3%
7GPT-6.1 SolPiOpenAI38.7%
8GPT-5.6 SolPiOpenAI37.5%
9GPT-6 AstraPiOpenAI37.5%
10Claude Sonnet 5.5Claude CodeAnthropic36.5%
11GPT-5.6 SolCodexOpenAI36.3%
12Claude Sonnet 5.5PiAnthropic34.9%
13Claude Opus 4.8PiAnthropic33.3%
14GPT-5.5PiOpenAI32.1%
15GPT-6 SolPiOpenAI31.6%
16Claude Opus 5Claude CodeAnthropic30.9%
17GPT-6 SolCodexOpenAI30.9%
18Claude Fable 5.1*PiAnthropic29.8%LSVP
19Claude Opus 4.7Claude CodeAnthropic29.8%
20Gemini 3.7 FlashPiGoogle29.8%
21Gemini 3.8 FlashPiGoogle28.6%
22Gemini 4 ArgonPiGoogle28.6%
23Claude Opus 5PiAnthropic28.0%
24Claude Opus 4.8Claude CodeAnthropic27.4%
25Grok 4.6Grok BuildSpaceXAI27.4%
26Claude Opus 4.7PiAnthropic26.2%
27DeepSeek V4.1 FlashPiDeepSeek26.2%
28Grok 4.6PiSpaceXAI26.2%
29GPT-5.6 LunaCodexOpenAI25.0%
30Claude Sonnet 5PiAnthropic24.4%
31Grok 4.7PiSpaceXAI24.4%
32GPT-6 LunaPiOpenAI23.2%
33Claude Sonnet 4.6PiAnthropic22.6%
34GPT-5.6 LunaPiOpenAI22.6%
35Kimi K3PiMoonshot22.6%
36Mistral Large 4.0PiMistral20.8%
37Claude Opus 5.5PiAnthropic20.2%
38Claude Sonnet 5Claude CodeAnthropic20.2%
39Claude Opus 5.5Claude CodeAnthropic19.6%
40GPT-6 LunaCodexOpenAI19.6%
41GLM 5.3PiZ.ai18.4%
42Claude Sonnet 4.6Claude CodeAnthropic17.3%
43Nemotron 3 Ultra 550B A55BPiNVIDIA15.9%
44Nemotron 3.5 LightningPiNVIDIA4.8%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.

LSVP: Anthropic's safety-filter-exempt evaluation variant, which produces fewer refusals on biology prompts. LSVP results are reported alongside the model's standard run and are not a replacement for it.