GSMA Open Telco Leaderboard
Telecommunications-domain model leaderboard across TeleQnA, TeleTables, ORANBench, srsRANBench, TeleMath, TeleLogs, and 3GPP pattern-matching benchmarks.
85rows
averageprimary metric
2026-05-06sampled
Metadata
Metrics
Average, Benchmarks Completed, Teleqna, Teletables, Oranbench, Srsranbench, Telemath, Telelogs, Three Gpp
| Rank | Subject | Average | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | OTel-LLM-8.3B-QnA | 85.98 | — | Imported | 2026-05-06 |
| 2 | gemini-3.1-pro-preview | 75.55 |  Gemini 3.1 Pro Preview google-gemini-3.1-pro-preview | Imported | 2026-05-06 |
| 3 | gemini-3-pro-preview | 74.65 | Gemini 3 google-gemini-3 | Imported | 2026-05-06 |
| 4 | LTM | 73.59 | — | Imported | 2026-05-06 |
| 5 | claude-opus-4.6 | 73.30 |  Claude Opus 4.6 anthropic-claude-opus-4.6 | Imported | 2026-05-06 |
| 6 | gpt-5 | 71.88 |  GPT-5 openai-gpt-5 | Imported | 2026-05-06 |
| 7 | gemini-3-flash-preview | 70.41 | Gemini 3 Flash Preview google-gemini-3-flash-preview | Imported | 2026-05-06 |
| 8 | claude-opus-4.5 | 69.64 | Claude Opus 4.5 anthropic-claude-opus-4.5 | Imported | 2026-05-06 |
| 9 | kimi-k2.5 | 69.42 | MoonshotAI: Kimi K2.5 moonshotai-kimi-k2.5 | Imported | 2026-05-06 |
| 10 | o3 | 69.39 | o3 openai-o3 | Imported | 2026-05-06 |
| 11 | grok-4-fast | 68.42 | Grok 4 Fast x-ai-grok-4-fast | Imported | 2026-05-06 |
| 12 | claude-opus-4 | 68.25 | Claude Opus 4 anthropic-claude-opus-4 | Imported | 2026-05-06 |
| 13 | o1 | 68.08 | o1 openai-o1 | Imported | 2026-05-06 |
| 14 | claude-opus-4.1 | 68.04 | Claude Opus 4.1 anthropic-claude-opus-4.1 | Imported | 2026-05-06 |
| 15 | grok-4.1-fast | 67.14 | Grok 4.1 Fast x-ai-grok-4.1-fast | Imported | 2026-05-06 |
| 16 | claude-sonnet-4.5 | 66.04 | Claude Sonnet 4.5 anthropic-claude-sonnet-4.5 | Imported | 2026-05-06 |
| 17 | claude-3.7-sonnet | 65.56 | Claude 3.7 Sonnet anthropic-claude-3.7-sonnet | Imported | 2026-05-06 |
| 18 | claude-sonnet-4 | 64.81 | Claude Sonnet 4 anthropic-claude-sonnet-4 | Imported | 2026-05-06 |
| 19 | minimax-m2.5 | 64.68 |  MiniMax M2.5 minimax-minimax-m2.5 | Imported | 2026-05-06 |
| 20 | grok-code-fast-1 | 64.21 | Grok Code Fast 1 x-ai-grok-code-fast-1 | Imported | 2026-05-06 |
| 21 | gemini-2.5-pro | 63.97 | Gemini 2.5 Pro google-gemini-2.5-pro | Imported | 2026-05-06 |
| 22 | qwen3-235b-a22b-2507 | 63.62 |  Qwen3 235B A22B Instruct 2507 qwen-qwen3-235b-a22b-2507 | Imported | 2026-05-06 |
| 23 | gpt-4.1 | 63.39 | GPT-4.1 openai-gpt-4.1 | Imported | 2026-05-06 |
| 24 | gemini-2.5-flash | 63.30 | Gemini 2.5 Flash google-gemini-2.5-flash | Imported | 2026-05-06 |
| 25 | gpt-5.2 | 63.15 | GPT-5.2 openai-gpt-5.2 | Imported | 2026-05-06 |
| 26 | o4-mini | 63.07 | o4 Mini openai-o4-mini | Imported | 2026-05-06 |
| 27 | gemini-2.0-flash-001 | 61.40 | Gemini 2.0 Flash google-gemini-2.0-flash | Imported | 2026-05-06 |
| 28 | grok-3-mini | 61.04 | Grok 3 Mini x-ai-grok-3-mini | Imported | 2026-05-06 |
| 29 | claude-3.5-sonnet | 60.87 | Claude 3.5 Sonnet anthropic-claude-3.5-sonnet | Imported | 2026-05-06 |
| 30 | mimo-v2-flash | 60.85 |  MiMo-V2-Flash xiaomi-mimo-v2-flash | Imported | 2026-05-06 |
| 31 | gpt-5-nano | 60.30 | GPT-5 Nano openai-gpt-5-nano | Imported | 2026-05-06 |
| 32 | gpt-5.1 | 60.15 | GPT-5.1 openai-gpt-5.1 | Imported | 2026-05-06 |
| 33 | claude-haiku-4.5 | 59.99 | Claude Haiku 4.5 anthropic-claude-haiku-4.5 | Imported | 2026-05-06 |
| 34 | llama-4-maverick | 59.60 |  Llama 4 Maverick meta-llama-4-maverick | Imported | 2026-05-06 |
| 35 | deepseek-v3-0324 | 59.28 |  DeepSeek V3 0324 deepseek-deepseek-chat-v3-0324 | Imported | 2026-05-06 |
| 36 | gpt-oss-120b | 58.27 | gpt-oss-120b openai-gpt-oss-120b | Imported | 2026-05-06 |
| 37 | gpt-4.1-mini | 58.02 | GPT-4.1 Mini openai-gpt-4.1-mini | Imported | 2026-05-06 |
| 38 | llama-v3p3-70b-instruct | 54.66 | — | Imported | 2026-05-06 |
| 39 | qwen2.5-72b | 53.97 | Qwen2.5 72B Instruct qwen-qwen-2.5-72b-instruct | Imported | 2026-05-06 |
| 40 | command-a | 53.50 | Command A cohere-command-a | Imported | 2026-05-06 |
| 41 | mistral-small-24b | 51.63 | — | Imported | 2026-05-06 |
| 42 | gpt-4o-mini | 51.25 | GPT-4o-mini openai-gpt-4o-mini | Imported | 2026-05-06 |
| 43 | qwen2.5-32b | 50.67 | — | Imported | 2026-05-06 |
| 44 | phi-4-14b | 50.45 | — | Imported | 2026-05-06 |
| 45 | gemma3-27b | 50.43 | Gemma 3 27B google-gemma-3-27b-it | Imported | 2026-05-06 |
| 46 | gpt-5-mini | 50.20 | GPT-5 Mini openai-gpt-5-mini | Imported | 2026-05-06 |
| 47 | claude-3.5-haiku | 49.52 | Claude 3.5 Haiku anthropic-claude-3.5-haiku | Imported | 2026-05-06 |
| 48 | gpt-4 | 48.58 | GPT-4 openai-gpt-4 | Imported | 2026-05-06 |
| 49 | qwen2.5-14b | 48.54 | — | Imported | 2026-05-06 |
| 50 | gpt-4.1-nano | 48.28 | GPT-4.1 Nano openai-gpt-4.1-nano | Imported | 2026-05-06 |
| 51 | qwen3-32b | 46.77 | Qwen3 32B qwen-qwen3-32b | Imported | 2026-05-06 |
| 52 | mistral-small-22b | 46.66 | — | Imported | 2026-05-06 |
| 53 | gemma3-12b | 46.38 | Gemma 3 12B google-gemma-3-12b-it | Imported | 2026-05-06 |
| 54 | falcon3-10b | 45.88 | — | Imported | 2026-05-06 |
| 55 | gemma2-27b | 45.85 | Gemma 2 27B google-gemma-2-27b-it | Imported | 2026-05-06 |
| 56 | claude-3-haiku | 45.84 | Claude 3 Haiku anthropic-claude-3-haiku | Imported | 2026-05-06 |
| 57 | qwen2.5-7b | 45.79 | — | Imported | 2026-05-06 |
| 58 | claude-sonnet-4.6 | 44.78 | Claude Sonnet 4.6 anthropic-claude-sonnet-4.6 | Imported | 2026-05-06 |
| 59 | phi-4 | 44.41 |  Phi 4 microsoft-phi-4 | Imported | 2026-05-06 |
| 60 | gpt-3.5-turbo | 43.85 | GPT-3.5 Turbo openai-gpt-3.5-turbo | Imported | 2026-05-06 |
| 61 | granite3.2-8b | 43.37 | — | Imported | 2026-05-06 |
| 62 | deepseek-r1-0528 | 43.37 | R1 0528 deepseek-deepseek-r1-0528 | Imported | 2026-05-06 |
| 63 | gemma2-9b | 43.36 | — | Imported | 2026-05-06 |
| 64 | qwen2.5-coder-7b | 42.10 | — | Imported | 2026-05-06 |
| 65 | mistral-nemo-12b | 41.77 | — | Imported | 2026-05-06 |
| 66 | granite3.3-8b | 41.48 | — | Imported | 2026-05-06 |
| 67 | qwen2.5-3b | 41.33 | — | Imported | 2026-05-06 |
| 68 | qwen3-8b | 41.07 | Qwen3 8B qwen-qwen3-8b | Imported | 2026-05-06 |
| 69 | deepseek-v3p2 | 40.90 | — | Imported | 2026-05-06 |
| 70 | phi-3.5-mini | 40.80 | — | Imported | 2026-05-06 |
| 71 | internlm2.5-20b | 40.59 | — | Imported | 2026-05-06 |
| 72 | phi-4-mini | 40.53 | — | Imported | 2026-05-06 |
| 73 | internlm2.5-7b | 40.38 | — | Imported | 2026-05-06 |
| 74 | deepseek-r1-32b | 40.35 | — | Imported | 2026-05-06 |
| 75 | gemma3-4b | 39.70 | Gemma 3 4B google-gemma-3-4b-it | Imported | 2026-05-06 |
| 76 | falcon3-3b | 37.72 | — | Imported | 2026-05-06 |
| 77 | command-r7b-12-2024 | 35.58 | Command R7B (12-2024) cohere-command-r7b-12-2024 | Imported | 2026-05-06 |
| 78 | gemma2-2b | 35.30 | — | Imported | 2026-05-06 |
| 79 | qwen2.5-1.5b | 35.20 | — | Imported | 2026-05-06 |
| 80 | mixtral-8x7b | 34.90 | — | Imported | 2026-05-06 |
| 81 | mistral-7b | 31.03 | — | Imported | 2026-05-06 |
| 82 | gemma3-1b | 27.27 | — | Imported | 2026-05-06 |
| 83 | qwen2.5-0.5b | 24.31 | — | Imported | 2026-05-06 |
| 84 | falcon3-1b | 22.55 | — | Imported | 2026-05-06 |
| 85 | falcon3-7b | 17.85 | — | Imported | 2026-05-06 |
No matching rows.