benchmarks.bio

Omics · Capabilities

MetagenomicsBench results

Agentic microbial community analysis tasks spanning shotgun, amplicon, long-read and spatially integrated metagenomics.

Published score: Full benchmark (100 evaluations) · short horizon · data updated 2026-10-09

This page reports published MetagenomicsBench scores from benchmarks.bio. MetagenomicsBench contains 100 evaluations built from real experimental data, each one graded deterministically against the biological result the original analysis reached, so a run counts as a pass only when the agent recovers that result rather than when it produces plausible-looking output. Results are reported per model and per harness rather than per model alone, because the harness an agent runs under changes its score substantially. Scores use a 0-100 percentage scale and are not comparable across benchmarks; see the linked repository and paper for task construction, grading, and confidence-interval methodology.

Published MetagenomicsBench scores
RankModelHarnessProviderScore
1Claude Sonnet 5.5Claude CodeAnthropic60.0%
2Claude Sonnet 5.5PiAnthropic60.0%
3Claude Opus 5PiAnthropic54.0%
4Claude Opus 5Claude CodeAnthropic53.3%
5Claude Opus 4.8Claude CodeAnthropic50.0%
6GPT-6 AstraCodexOpenAI49.7%
7Grok 4.7Grok BuildSpaceXAI48.7%
8Claude Opus 4.8PiAnthropic48.3%
9Grok 4.7PiSpaceXAI48.3%
10GPT-6 AstraPiOpenAI47.0%
11Claude Opus 5.5Claude CodeAnthropic43.7%
12Claude Sonnet 5PiAnthropic42.3%
13Grok 4.6Grok BuildSpaceXAI42.0%
14GPT-6 SolPiOpenAI42.0%
15Claude Sonnet 5Claude CodeAnthropic41.0%
16GPT-6 SolCodexOpenAI40.7%
17Claude Opus 5.5PiAnthropic39.3%
18Grok 4.6PiSpaceXAI38.7%
19DeepSeek V4.1 FlashPiDeepSeek38.0%
20Claude Opus 4.7PiAnthropic35.3%
21Gemini 3.7 FlashPiGoogle31.7%
22GPT-5.6 SolPiOpenAI31.3%
23GPT-6 LunaCodexOpenAI31.0%
24GPT-6 LunaPiOpenAI30.7%
25GPT-5.6 SolCodexOpenAI28.7%
26Claude Sonnet 4.6Claude CodeAnthropic28.3%
27Claude Sonnet 4.6PiAnthropic27.7%
28Kimi K3PiMoonshot27.3%
29Gemini 3.8 FlashPiGoogle26.7%
30GPT-5.6 LunaCodexOpenAI24.3%
31GPT-5.6 LunaPiOpenAI22.7%

Methodology and provenance

Scores use a 0–100 percentage scale. See Paper PDF, Original publication, Repository for task construction, grading, aggregation, and uncertainty details.