Compare current model-and-harness results for SpatialBench. Agentic analysis of real spatial transcriptomics datasets across platforms and biological task types. Also known as SpatialBench Verified. Current V1 covers 115 evaluations and 43 ranked configurations. Data updated 2026-11-13. The highest-ranked published configurations are GPT-6.1 Terra (Pi, 73.3%); Claude Opus 5.5 (Pi, 72.8%); Claude Sonnet 5.5 (Pi, 72.8%). Scores report benchmark-specific biological task performance on a 0–100 percentage scale. See the linked paper and repository for task construction, grading and uncertainty methodology. Results describe the complete model and agent harness used for each run, and are not comparable across different benchmarks or evaluation versions.
Original study and current evaluation set
The original SpatialBench study reports 146 evaluations. This leaderboard reports the current V1 evaluation set of 115 evaluations. These are separately scoped releases. Use the current V1 set when citing this table and the original study when citing its historical results. Score comparisons require the same evaluation version and scoring rules. Original study.
| Rank | Model | Harness | Provider | Score | Variant |
|---|---|---|---|---|---|
| 1 | GPT-6.1 Terra | Pi | OpenAI | 73.3% | |
| 2 | Claude Opus 5.5 | Pi | Anthropic | 72.8% | |
| 3 | Claude Sonnet 5.5 | Pi | Anthropic | 72.8% | |
| 4 | Muse Wonder 1.0 | Pi | Meta | 71.9% | |
| 5 | GPT-6.1 Terra | Codex | OpenAI | 70.7% | |
| 6 | Claude Sonnet 5.5 | Claude Code | Anthropic | 70.1% | |
| 7 | Claude Opus 5.5 | Claude Code | Anthropic | 69.6% | |
| 8 | Grok 4.7 | Pi | SpaceXAI | 69.6% | |
| 9 | Claude Opus 5.5* | Pi | Anthropic | 69.0% | LSVP |
| 10 | Gemini 4 Argon | Pi | 69.0% | ||
| 11 | Claude Opus 5.5* | Claude Code | Anthropic | 68.7% | LSVP |
| 12 | Claude Opus 5 | Pi | Anthropic | 68.4% | |
| 13 | Claude Opus 5 | Claude Code | Anthropic | 68.4% | |
| 14 | GPT-5.6 Sol | Codex | OpenAI | 68.1% | |
| 15 | Claude Fable 5.1* | Pi | Anthropic | 67.5% | LSVP |
| 16 | GPT-5.6 Sol | Pi | OpenAI | 67.5% | |
| 17 | GPT-6 Astra | Codex | OpenAI | 67.5% | |
| 18 | GPT-6 Sol | Pi | OpenAI | 67.5% | |
| 19 | GPT-6.1 Sol | Pi | OpenAI | 67.3% | |
| 20 | Grok 4.6 | Pi | SpaceXAI | 67.3% | |
| 21 | Claude Opus 4.8 | Claude Code | Anthropic | 67.0% | |
| 22 | GPT-6.1 Sol | Codex | OpenAI | 67.0% | |
| 23 | Claude Sonnet 5 | Pi | Anthropic | 66.7% | |
| 24 | GPT-6 Astra | Pi | OpenAI | 66.7% | |
| 25 | Grok 4.6 | Grok Build | SpaceXAI | 66.1% | |
| 26 | Claude Opus 4.8 | Pi | Anthropic | 65.8% | |
| 27 | Claude Sonnet 5 | Claude Code | Anthropic | 65.8% | |
| 28 | GPT-5.5 | Pi | OpenAI | 64.1% | |
| 29 | Kimi K3 | Pi | Moonshot | 63.5% | |
| 30 | DeepSeek V4.1 Flash | Pi | DeepSeek | 63.2% | |
| 31 | GPT-5.6 Luna | Pi | OpenAI | 60.9% | |
| 32 | GPT-6 Luna | Pi | OpenAI | 59.7% | |
| 33 | Gemini 3.8 Flash | Pi | 59.4% | ||
| 34 | Gemini 3.7 Flash | Pi | 59.1% | ||
| 35 | GPT-5.6 Luna | Codex | OpenAI | 58.5% | |
| 36 | GLM 5.3 | Pi | Z.ai | 57.4% | |
| 37 | Claude Opus 4.7 | Claude Code | Anthropic | 56.5% | |
| 38 | Mistral Large 4.0 | Pi | Mistral | 55.9% | |
| 39 | Claude Opus 4.7 | Pi | Anthropic | 54.8% | |
| 40 | Claude Sonnet 4.6 | Pi | Anthropic | 53.9% | |
| 41 | Claude Sonnet 4.6 | Claude Code | Anthropic | 53.3% | |
| 42 | Nemotron 3 Ultra 550B A55B | Pi | NVIDIA | 47.0% | |
| 43 | Nemotron 3.5 Lightning | Pi | NVIDIA | 29.0% |
Methodology and provenance
Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.
LSVP: Anthropic's safety-filter-exempt evaluation variant, which produces fewer refusals on biology prompts. LSVP results are reported alongside the model's standard run and are not a replacement for it.