Ukrainian LLM Leaderboard
Leaderboard for Ukrainian-language LLM evaluation across translated and native tasks including MMLU, FLORES, SQuAD, ARC, GSM8K, IFEval, WMT, and ZNO.
13rows
average_rankprimary metric
2026-05-06sampled
Metadata
Metrics
Average Rank (lower is better), Evaluated Tasks, Belebele Ukrainian, MMLU Ukrainian, FLORES Ukrainian, Long FLORES Ukrainian, SQuAD Ukrainian, XLSum Ukrainian, TriviaQA Ukrainian, ARC Challenge Ukrainian, ARC Easy Ukrainian, Winogrande Ukrainian, GSM8K Ukrainian, IFEval Ukrainian, WMT EN to UK, ZNO Geography, ZNO History, ZNO Language and Literature, ZNO Math
| Rank | Subject | Average Rank | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | google/gemma-4-26B-A4B-it (reasoning) | 1.18 | Gemma 4 26B A4B google-gemma-4-26b-a4b-it | Imported | 2026-05-06 |
| 2 | INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0 | 4.35 | — | Imported | 2026-05-06 |
| 3 | le-llm/lapa-12b-pt | 5.29 | — | Imported | 2026-05-06 |
| 4 | oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Static-Nadiia | 5.47 | — | Imported | 2026-05-06 |
| 5 | google/gemma-3-12b-pt | 5.47 | — | Imported | 2026-05-06 |
| 6 | Qwen/Qwen3-8B-Base | 6.06 | — | Imported | 2026-05-06 |
| 7 | lapa-llm/lapa-v0.1.2-instruct | 6.59 | — | Imported | 2026-05-06 |
| 8 | google/gemma-3-12b-it | 7.82 | Gemma 3 12B google-gemma-3-12b-it | Imported | 2026-05-06 |
| 9 | meta-llama/Llama-3.1-8B | 7.94 | — | Imported | 2026-05-06 |
| 10 | google/gemma-3-4b-pt | 8.65 | — | Imported | 2026-05-06 |
| 11 | meta-llama/Llama-3.1-8B-Instruct | 9.12 | Llama 3.1 8B Instruct meta-llama-llama-3.1-8b-instruct | Imported | 2026-05-06 |
| 12 | google/gemma-3-4b-it | 9.88 | Gemma 3 4B google-gemma-3-4b-it | Imported | 2026-05-06 |
| 13 | Qwen/Qwen3-8B | 12.18 | Qwen3 8B qwen-qwen3-8b | Imported | 2026-05-06 |
No matching rows.