ECLeKTic
A multilingual closed-book question answering dataset that evaluates cross-lingual knowledge transfer in large language models across 12 languages, using knowledge-seeking questions based on Wikipedia articles that exist only in one language
8rows
scoreprimary metric
2026-05-06sampled
Metadata
Metrics
Score, Normalized Score
| Rank | Subject | Score | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | Gemma 3n E4B Instructed | 0.19 |  Gemma 3n 4B google-gemma-3n-e4b-it | Self-reported | 2026-05-06 |
| 2 | Gemma 3 27B | 0.17 | Gemma 3 27B google-gemma-3-27b-it | Self-reported | 2026-05-06 |
| 3 | Gemma 3 12B | 0.10 | Gemma 3 12B google-gemma-3-12b-it | Self-reported | 2026-05-06 |
| 4 | Gemma 3 4B | 0.05 | Gemma 3 4B google-gemma-3-4b-it | Self-reported | 2026-05-06 |
| 5 | Gemma 3n E2B Instructed | 0.03 | Gemma 3n 2B google-gemma-3n-e2b-it | Self-reported | 2026-05-06 |
| 5 | Gemma 3n E2B Instructed LiteRT (Preview) | 0.03 | Gemma 3n 2B google-gemma-3n-e2b-it | Self-reported | 2026-05-06 |
| 7 | Gemma 3n E4B Instructed LiteRT Preview | 0.02 | Gemma 3n 4B google-gemma-3n-e4b-it | Self-reported | 2026-05-06 |
| 8 | Gemma 3 1B | 0.01 | — | Self-reported | 2026-05-06 |
No matching rows.