RuneBench
Evaluates AI agents playing RuneScape through a TypeScript SDK and emulated game server, with agents reading world state, consulting game knowledge, and executing in-game actions.
18rows
ln_scoreprimary metric
2026-05-05sampled
Metadata
Metrics
Woodcutting XP/min, Firemaking XP/min, Hitpoints XP/min, Attack XP/min, Thieving XP/min, Defence XP/min, Ranged XP/min, Magic XP/min, Prayer XP/min, Mining XP/min, Strength XP/min, Fletching XP/min, Fishing XP/min, Cooking XP/min, Smithing XP/min, Crafting XP/min, <ln>
| Rank | Subject | <ln> | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | GPT-5.5 | 5.30 |  GPT-5.5 openai-gpt-5.5 | Imported | 2026-05-05 |
| 2 | GPT-5.4 | 4.70 | GPT-5.4 openai-gpt-5.4 | Imported | 2026-05-05 |
| 3 | Gemini Flash | 4.70 |  Google Gemini Flash Latest google-gemini-flash-latest | Imported | 2026-05-05 |
| 4 | Opus 4.7 | 4.60 |  Claude Opus 4.7 anthropic-claude-opus-4.7 | Imported | 2026-05-05 |
| 5 | Gemini 3.1 | 4.50 | Gemini 3.1 Pro Preview google-gemini-3.1-pro-preview | Imported | 2026-05-05 |
| 6 | Opus 4.6 | 4.40 | Claude Opus 4.6 anthropic-claude-opus-4.6 | Imported | 2026-05-05 |
| 7 | Codex 5.3 | 4.30 | GPT-5.3-Codex openai-gpt-5.3-codex | Imported | 2026-05-05 |
| 8 | GPT-5.4 Mini | 4.10 | GPT-5.4 Mini openai-gpt-5.4-mini | Imported | 2026-05-05 |
| 9 | Opus 4.5 | 4.10 | Claude Opus 4.5 anthropic-claude-opus-4.5 | Imported | 2026-05-05 |
| 10 | Gemini 3 | 3.80 | Gemini 3 google-gemini-3 | Imported | 2026-05-05 |
| 11 | Sonnet 4.5 | 3.20 | Claude Sonnet 4.5 anthropic-claude-sonnet-4.5 | Imported | 2026-05-05 |
| 12 | Sonnet 4.6 | 3.20 | Claude Sonnet 4.6 anthropic-claude-sonnet-4.6 | Imported | 2026-05-05 |
| 13 | GPT-5.4 Nano | 2.30 | GPT-5.4 Nano openai-gpt-5.4-nano | Imported | 2026-05-05 |
| 14 | Kimi K2.5 | 2.10 | MoonshotAI: Kimi K2.5 moonshotai-kimi-k2.5 | Imported | 2026-05-05 |
| 15 | GLM 5 | 1.90 | GLM 5 z-ai-glm-5 | Imported | 2026-05-05 |
| 16 | Haiku 4.5 | 1.60 | Claude Haiku 4.5 anthropic-claude-haiku-4.5 | Imported | 2026-05-05 |
| 17 | Qwen3 Coder | 1.20 |  Qwen3 Coder 480B A35B qwen-qwen3-coder | Imported | 2026-05-05 |
| 18 | Qwen3.5 35B | 0.70 | Qwen3.5-35B-A3B qwen-qwen3.5-35b-a3b | Imported | 2026-05-05 |
No matching rows.