Claude 3.5 Haiku
Claude / Anthropic
29scores
19benchmarks
$0.8 / $4 per 1M tokenscost in/out
Metadata
Claude Closed/API
Aliases: anthropic-claude-3-5-haiku, anthropic-claude-3.5-haiku, anthropic/claude-3-5-haiku, anthropic/claude-3.5-haiku, claude-3-5-haiku, claude-3.5-haiku
| Benchmark | Category | Rank | Score | Sampled |
|---|---|---|---|---|
| Tau2-Bench Telecom | Agentic | 285 | 24.6% | 2026-05-11 |
| Terminal-Bench Hard | Agentic | 306 | 2.3% | 2026-05-11 |
| TextClass Benchmark | Classification | 89 | 1413.90 | 2026-05-06 |
| CadEval | Coding | 8 | 32 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 29 | 0.84 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 30 | 0.84 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 37 | 0.83 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 48 | 0.82 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 49 | 0.82 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 50 | 0.82 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 53 | 0.81 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 58 | 0.81 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 70 | 0.79 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 77 | 0.79 | 2026-05-06 |
| Natural Language to Mongosh | Coding | 95 | 0.75 | 2026-05-06 |
| SciCode | Coding | 290 | 27.4% | 2026-05-11 |
| GSMA Open Telco Leaderboard | Domain | 47 | 49.52 | 2026-05-06 |
| K-12EduBench | Education | 21 | 44.98 | 2026-05-27 |
| WeirdML | Generalization | 21 | 30.73 | 2026-05-06 |
| Artificial Analysis Intelligence Index | Intelligence | 260 | 18.66 | 2026-05-11 |
| Humanity's Last Exam | Intelligence | 456 | 3.5% | 2026-05-11 |
| MMLU-Pro | Intelligence | 258 | 63.4% | 2026-05-11 |
| FrontierMath 2025-02-28 Private | Mathematics | 23 | 0.34 | 2026-05-06 |
| OTIS Mock AIME 2024-2025 | Mathematics | 36 | 4.31 | 2026-05-06 |
| Balrog | Reasoning | 12 | 19.30 | 2026-05-06 |
| DROP | Reasoning | 8 | 0.83 | 2026-05-06 |
| GPQA Diamond | Reasoning | 393 | 40.8% | 2026-05-11 |
| CritPt | Science | 159 | 0% | 2026-05-11 |
| Lech Mazur Writing | Writing | 21 | 7.35 | 2026-05-06 |
No matching rows.