FLORES European Languages Leaderboard
European-language subset of FLORES-200 machine translation, focusing on translation pairs involving Polish and other European languages.
Metadata
Metrics
Average chrF, Average BLEU, Average TER (lower is better), bul_Cyrl-pol_Latn chrF, ces_Latn-pol_Latn chrF, dan_Latn-pol_Latn chrF, deu_Latn-pol_Latn chrF, ell_Grek-pol_Latn chrF, eng_Latn-pol_Latn chrF, est_Latn-pol_Latn chrF, fin_Latn-pol_Latn chrF, fra_Latn-pol_Latn chrF, hun_Latn-pol_Latn chrF, ita_Latn-pol_Latn chrF, lit_Latn-pol_Latn chrF, lvs_Latn-pol_Latn chrF, nld_Latn-pol_Latn chrF, por_Latn-pol_Latn chrF, ron_Latn-pol_Latn chrF, slk_Latn-pol_Latn chrF, slv_Latn-pol_Latn chrF, spa_Latn-pol_Latn chrF, swe_Latn-pol_Latn chrF, pol_Latn-bul_Cyrl chrF, pol_Latn-ces_Latn chrF, pol_Latn-dan_Latn chrF, pol_Latn-deu_Latn chrF, pol_Latn-ell_Grek chrF, pol_Latn-eng_Latn chrF, pol_Latn-est_Latn chrF, pol_Latn-fin_Latn chrF, pol_Latn-fra_Latn chrF, pol_Latn-hun_Latn chrF, pol_Latn-ita_Latn chrF, pol_Latn-lit_Latn chrF, pol_Latn-lvs_Latn chrF, pol_Latn-nld_Latn chrF, pol_Latn-por_Latn chrF, pol_Latn-ron_Latn chrF, pol_Latn-slk_Latn chrF, pol_Latn-slv_Latn chrF, pol_Latn-spa_Latn chrF, pol_Latn-swe_Latn chrF
| Rank | Subject | Average chrF | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | *EuroLLM-9B-Instruct | 50.86 | — | Imported | 2026-05-06 |
| 2 | gemma-3-12b-it | 50.03 |  Gemma 3 12B google-gemma-3-12b-it | Imported | 2026-05-06 |
| 3 | Bielik-11B-v3.0-Instruct | 48.84 | — | Imported | 2026-05-06 |
| 4 | Tower-Plus-9B | 47.35 | — | Imported | 2026-05-06 |
| 5 | phi-4 | 45.74 |  Phi 4 microsoft-phi-4 | Imported | 2026-05-06 |
| 6 | Qwen3-14B | 45.64 |  Qwen3 14B qwen-qwen3-14b | Imported | 2026-05-06 |
| 7 | Bielik-11B-v3-Base-20250730 | 45.61 | — | Imported | 2026-05-06 |
| 8 | Mistral-Nemo-Instruct-2407 | 43.28 |  Mistral: Mistral Nemo mistralai-mistral-nemo | Imported | 2026-05-06 |
| 9 | Qwen3-8B | 43.25 | Qwen3 8B qwen-qwen3-8b | Imported | 2026-05-06 |
| 10 | cogito-v1-preview-qwen-14B | 42.79 | — | Imported | 2026-05-06 |
| 11 | Qwen2.5-14B-Instruct | 42.36 | — | Imported | 2026-05-06 |
| 12 | Bielik-11B-v2.6-Instruct | 40.10 | — | Imported | 2026-05-06 |
| 13 | Qwen2.5-7B-Instruct | 39.84 | Qwen2.5 7B Instruct qwen-qwen-2.5-7b-instruct | Imported | 2026-05-06 |
| 14 | Mistral-7B-Instruct-v0.2 | 39.33 | — | Imported | 2026-05-06 |
| 15 | pllum-12b-nc-instruct-250715 | 38.38 | — | Imported | 2026-05-06 |
| 16 | PLLuM-12B-chat | 35.74 | — | Imported | 2026-05-06 |
| 17 | Bielik-11B-v2 | 35.73 | — | Imported | 2026-05-06 |
| 18 | Bielik-4.5B-v3.0-Instruct | 29.80 | — | Imported | 2026-05-06 |
| 19 | Bielik-1.5B-v3.0-Instruct | 26.66 | — | Imported | 2026-05-06 |
| 20 | Bielik-7B-v0.1-Instruct | 26.45 | — | Imported | 2026-05-06 |
No matching rows.