benchmarks.bio

Basic Research · Capabilities

NeuroscienceBench results

NeuroscienceBench tests whether AI agents can reach correct scientific conclusions from neuroscience research data, across sequencing, electrophysiology, optical physiology, EEG, brain-computer interface decoding, cell and tissue imaging, behavioral scoring and clinical biomarkers. Scores are the share of graded runs that reach the correct conclusion. Refusals, timeouts and harness errors are not graded and leave the denominator.

Published score: Current V1 evaluation set (91 evaluations) · short horizon · data updated 2026-11-08

This page reports published NeuroscienceBench scores from benchmarks.bio. NeuroscienceBench contains 91 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published NeuroscienceBench scores
RankModelHarnessProviderScoreVariant
1Claude Opus 5.5*PiAnthropic32.2%LSVP
2Claude Opus 5*PiAnthropic30.8%LSVP
3Claude Opus 5.5*Claude CodeAnthropic29.7%LSVP
4Claude Sonnet 5.5*Claude CodeAnthropic29.7%LSVP
5Claude Fable 5.1*PiAnthropic28.4%LSVP
6Grok 4.7Grok BuildSpaceXAI27.5%
7Claude Sonnet 5.5*PiAnthropic27.1%LSVP
8Claude Opus 5*Claude CodeAnthropic25.6%LSVP
9Claude Fable 5.1*Claude CodeAnthropic23.8%LSVP
10Grok 4.7PiSpaceXAI23.4%
11GPT-6 AstraPiOpenAI22.7%
12GPT-6.1 TerraPiOpenAI22.3%
13GPT-6.1 SolPiOpenAI22.0%
14DeepSeek V4.1 FlashPiDeepSeek22.0%
15GPT-6 LunaCodexOpenAI21.5%
16Grok 4.6Grok BuildSpaceXAI21.2%
17GPT-6 AstraCodexOpenAI20.5%
18Grok 4.6PiSpaceXAI20.5%
19GPT-6 LunaPiOpenAI20.4%
20GPT-6.1 SolCodexOpenAI20.1%
21GPT-6.1 TerraCodexOpenAI20.1%
22Claude Sonnet 5*PiAnthropic19.4%LSVP
23Mistral Large 4.0PiMistral19.4%
24Gemini 4 ArgonPiGoogle19.1%
25Claude Sonnet 5*Claude CodeAnthropic18.7%LSVP
26GLM 5.3PiZ.ai16.5%
27Kimi K3PiMoonshot16.5%
28Gemini 3.8 FlashPiGoogle15.8%
29GPT-5.6 SolCodexOpenAI15.8%
30GPT-5.6 LunaPiOpenAI15.0%
31GPT-5.6 SolPiOpenAI13.9%
32GPT-5.6 LunaCodexOpenAI12.5%
33Nemotron 3 Ultra 550B A55BPiNVIDIA12.1%
34Nemotron 3.5 LightningPiNVIDIA7.7%

Methodology and provenance

Scores use a 0–100 percentage scale. See Repository for task construction, grading, aggregation, and uncertainty details.

LSVP: Anthropic's safety-filter-exempt evaluation variant, which produces fewer refusals on biology prompts. LSVP results are reported alongside the model's standard run and are not a replacement for it.