TuRTLe Line Completion
TuRTLe line-completion leaderboard on RTL-Repo using exact match as the primary metric.
25rows
exact_matchprimary metric
2026-05-06sampled
Metadata
Metrics
Exact Match
| Rank | Subject | Exact Match | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | Qwen3 236B A22B | 41.94 | Qwen3 235B A22B qwen-qwen3-235b-a22b | Imported | 2026-05-06 |
| 2 | Qwen3 Coder 480B A35B | 38.88 | Qwen3 Coder 480B A35B qwen-qwen3-coder | Imported | 2026-05-06 |
| 3 | QwenCoder 2.5 14B | 37.53 | — | Imported | 2026-05-06 |
| 4 | Qwen2.5 72B | 37.44 | Qwen2.5 72B Instruct qwen-qwen-2.5-72b-instruct | Imported | 2026-05-06 |
| 5 | Llama 3.1 405B | 34.62 | — | Imported | 2026-05-06 |
| 6 | Kimi K2 Instruct 0905 | 33.65 | MoonshotAI: Kimi K2 0905 moonshotai-kimi-k2-0905 | Imported | 2026-05-06 |
| 7 | QwenCoder 2.5 32B | 31.07 | — | Imported | 2026-05-06 |
| 8 | Qwen2.5 32B | 28.93 | — | Imported | 2026-05-06 |
| 9 | Llama 3.(1-3) 70B | 28.72 | — | Imported | 2026-05-06 |
| 10 | Hermes-4-14B | 28.36 | — | Imported | 2026-05-06 |
| 11 | QwenCoder 2.5 7B | 28.33 | — | Imported | 2026-05-06 |
| 12 | SeedCoder 8B | 28.23 | — | Imported | 2026-05-06 |
| 13 | InCoder-32B | 27.14 | — | Imported | 2026-05-06 |
| 14 | HaVen-CodeQwen | 25.14 | — | Imported | 2026-05-06 |
| 15 | DeepSeek Coder 6.7B | 24.63 | — | Imported | 2026-05-06 |
| 16 | DeepSeek Coder 33B | 24.58 | — | Imported | 2026-05-06 |
| 17 | CodeLlama 70B | 24.33 | — | Imported | 2026-05-06 |
| 18 | CodeV-DS-6.7B | 21.26 | — | Imported | 2026-05-06 |
| 19 | CodeV-QW-7B | 20.94 | — | Imported | 2026-05-06 |
| 20 | RTLCoder DeepSeek | 19.35 | — | Imported | 2026-05-06 |
| 21 | OriGen | 17.07 | — | Imported | 2026-05-06 |
| 22 | OpenCoder 8B | 16.17 | — | Imported | 2026-05-06 |
| 23 | RTLCoder Mistral | 14.77 | — | Imported | 2026-05-06 |
| 24 | StarChat2 15B v0.1 | 13.42 | — | Imported | 2026-05-06 |
| 25 | CodeV-CL-7B | 12.27 | — | Imported | 2026-05-06 |
No matching rows.