TuRTLe Code Completion (Verilator)
TuRTLe leaderboard variant for RTL code completion evaluated with Verilator across VerilogEval MC and VeriGen.
44rows
aggregated_scoreprimary metric
2026-05-06sampled
Metadata
Metrics
Aggregated Score, Syntax, Functionality, Synthesis, Power, Performance, Area
| Rank | Subject | Aggregated Score | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | GLM-5-FP8 | 82.23 | GLM 5 z-ai-glm-5 | Imported | 2026-05-06 |
| 2 | Kimi-K2.5 | 81.65 | MoonshotAI: Kimi K2.5 moonshotai-kimi-k2.5 | Imported | 2026-05-06 |
| 3 | Gemma-4-31B-it | 80.51 |  Gemma 4 31B google-gemma-4-31b-it | Imported | 2026-05-06 |
| 4 | DeepSeek R1-0528 | 78.08 |  R1 0528 deepseek-deepseek-r1-0528 | Imported | 2026-05-06 |
| 5 | DeepSeek R1 | 75.99 | R1 deepseek-r1 | Imported | 2026-05-06 |
| 6 | DeepSeek V3.1 Terminus | 75.31 | DeepSeek V3.1 Terminus deepseek-deepseek-v3.1-terminus | Imported | 2026-05-06 |
| 7 | gpt-oss-120b | 74.91 |  gpt-oss-120b openai-gpt-oss-120b | Imported | 2026-05-06 |
| 8 | Seed-OSS-36B | 71.92 | — | Imported | 2026-05-06 |
| 9 | Kimi K2 Instruct 0905 | 71.79 | MoonshotAI: Kimi K2 0905 moonshotai-kimi-k2-0905 | Imported | 2026-05-06 |
| 10 | Gemini 2.5 Flash (Medium) | 70.19 | Gemini 2.5 Flash google-gemini-2.5-flash | Imported | 2026-05-06 |
| 11 | Qwen3 236B A22B | 66.80 |  Qwen3 235B A22B qwen-qwen3-235b-a22b | Imported | 2026-05-06 |
| 12 | gpt-oss-20b | 65.92 | gpt-oss-20b openai-gpt-oss-20b | Imported | 2026-05-06 |
| 13 | Qwen3 Coder 480B A35B | 58.17 | Qwen3 Coder 480B A35B qwen-qwen3-coder | Imported | 2026-05-06 |
| 14 | InCoder-32B-Thinking | 55.49 | — | Imported | 2026-05-06 |
| 15 | Llama 3.1 405B | 55.06 | — | Imported | 2026-05-06 |
| 16 | InCoder-32B | 53.61 | — | Imported | 2026-05-06 |
| 17 | Qwen2.5 72B | 52.29 | Qwen2.5 72B Instruct qwen-qwen-2.5-72b-instruct | Imported | 2026-05-06 |
| 18 | OriGen | 52.16 | — | Imported | 2026-05-06 |
| 19 | CodeV-QW-7B | 51.20 | — | Imported | 2026-05-06 |
| 20 | HaVen-CodeQwen | 49.91 | — | Imported | 2026-05-06 |
| 21 | SeedCoder 8B Reasoning | 48.88 | — | Imported | 2026-05-06 |
| 22 | Qwen3-8B | 48.82 | Qwen3 8B qwen-qwen3-8b | Imported | 2026-05-06 |
| 23 | CodeV-DS-6.7B | 47.41 | — | Imported | 2026-05-06 |
| 24 | QwenCoder 2.5 32B | 47.30 | — | Imported | 2026-05-06 |
| 25 | Llama 3.(1-3) 70B | 44.71 | — | Imported | 2026-05-06 |
| 26 | Qwen2.5 32B | 43.61 | — | Imported | 2026-05-06 |
| 27 | QwenCoder 2.5 14B | 42.39 | — | Imported | 2026-05-06 |
| 28 | QwQ 32B | 41.14 | — | Imported | 2026-05-06 |
| 29 | DeepSeek Coder 33B | 39.43 | — | Imported | 2026-05-06 |
| 30 | StarChat2 15B v0.1 | 38.42 | — | Imported | 2026-05-06 |
| 31 | Hermes-4-14B-Reasoning | 38.19 | — | Imported | 2026-05-06 |
| 32 | SeedCoder 8B | 37.70 | — | Imported | 2026-05-06 |
| 33 | RTLCoder DeepSeek | 37.50 | — | Imported | 2026-05-06 |
| 34 | OpenCoder 8B | 36.16 | — | Imported | 2026-05-06 |
| 35 | CodeLlama 70B | 35.64 | — | Imported | 2026-05-06 |
| 36 | QwenCoder 2.5 7B | 35.37 | — | Imported | 2026-05-06 |
| 37 | DeepCoder 14B | 33.49 | — | Imported | 2026-05-06 |
| 38 | CodeV-CL-7B | 32.82 | — | Imported | 2026-05-06 |
| 39 | DeepSeek Coder 6.7B | 30.16 | — | Imported | 2026-05-06 |
| 40 | RTLCoder Mistral | 29.36 | — | Imported | 2026-05-06 |
| 41 | Hermes-4-14B | 28.99 | — | Imported | 2026-05-06 |
| 42 | CodeV R1 Distill Qwen 7B | 25.62 | — | Imported | 2026-05-06 |
| 43 | DeepSeek R1 Distill Qwen 14B | 24.81 | — | Imported | 2026-05-06 |
| 44 | Magistral Small 2506 | 23.47 | — | Imported | 2026-05-06 |
No matching rows.