ProgramBench (Anthropic Harness)

Anthropic system-card ProgramBench evaluation on the 166-task golden subset, reported as hidden behavioral test pass rate across 1-5 episodes.

2rows
scoreprimary metric
2026-05-28sampled

Metadata

ID
programbench_anthropic
Category
Software Engineering
Release
Unknown

Metrics

Best hidden test pass rate, Lowest reported hidden test pass rate

Latest Results

Provider-published system-card benchmark scores parsed from Anthropic's Claude Opus 4.8 capability evaluation tables. Rows are marked self-reported and should be interpreted as source claims unless independently reproduced.

Rank Subject Best hidden test pass rate Model Match Provenance Sampled
1 Claude Opus 4.8 88% Claude Opus 4.8
anthropic-claude-opus-4.8
 		Self-reported 2026-05-28
2 Claude Opus 4.7 84% Claude Opus 4.7
anthropic-claude-opus-4.7
 		Self-reported 2026-05-28