TuRTLe Line Completion

TuRTLe line-completion leaderboard on RTL-Repo using exact match as the primary metric.

25rows
exact_matchprimary metric
2026-05-06sampled

Metadata

Metrics

Exact Match

Latest Results

Rank Subject Exact Match Model Match Provenance Sampled
1 Qwen3 236B A22B 41.94 Qwen3 235B A22B
qwen-qwen3-235b-a22b
Imported 2026-05-06
2 Qwen3 Coder 480B A35B 38.88 Qwen3 Coder 480B A35B
qwen-qwen3-coder
Imported 2026-05-06
3 QwenCoder 2.5 14B 37.53 Imported 2026-05-06
4 Qwen2.5 72B 37.44 Qwen2.5 72B Instruct
qwen-qwen-2.5-72b-instruct
Imported 2026-05-06
5 Llama 3.1 405B 34.62 Imported 2026-05-06
6 Kimi K2 Instruct 0905 33.65 KIMI MoonshotAI: Kimi K2 0905
moonshotai-kimi-k2-0905
Imported 2026-05-06
7 QwenCoder 2.5 32B 31.07 Imported 2026-05-06
8 Qwen2.5 32B 28.93 Imported 2026-05-06
9 Llama 3.(1-3) 70B 28.72 Imported 2026-05-06
10 Hermes-4-14B 28.36 Imported 2026-05-06
11 QwenCoder 2.5 7B 28.33 Imported 2026-05-06
12 SeedCoder 8B 28.23 Imported 2026-05-06
13 InCoder-32B 27.14 Imported 2026-05-06
14 HaVen-CodeQwen 25.14 Imported 2026-05-06
15 DeepSeek Coder 6.7B 24.63 Imported 2026-05-06
16 DeepSeek Coder 33B 24.58 Imported 2026-05-06
17 CodeLlama 70B 24.33 Imported 2026-05-06
18 CodeV-DS-6.7B 21.26 Imported 2026-05-06
19 CodeV-QW-7B 20.94 Imported 2026-05-06
20 RTLCoder DeepSeek 19.35 Imported 2026-05-06
21 OriGen 17.07 Imported 2026-05-06
22 OpenCoder 8B 16.17 Imported 2026-05-06
23 RTLCoder Mistral 14.77 Imported 2026-05-06
24 StarChat2 15B v0.1 13.42 Imported 2026-05-06
25 CodeV-CL-7B 12.27 Imported 2026-05-06