CC-OCR
A comprehensive OCR benchmark for evaluating Large Multimodal Models (LMMs) in literacy. Comprises four OCR-centric tracks: multi-scene text reading, multilingual text reading, document parsing, and key information extraction. Contains 39 subsets with 7,058 fully annotated images, 41% sourced from real applications. Tests capabilities including text grounding, multi-orientation text recognition, and detecting hallucination/repetition across diverse visual challenges.
18rows
scoreprimary metric
2026-05-06sampled
Metadata
Metrics
Score, Normalized Score
| Rank | Subject | Score | Model Match | Provenance | Sampled |
|---|---|---|---|---|---|
| 1 | Qwen3.6 Plus | 0.83 | Qwen3.6 Plus qwen-qwen3.6-plus | Self-reported | 2026-05-06 |
| 2 | Qwen3 VL 235B A22B Instruct | 0.82 | Qwen3 VL 235B A22B Instruct qwen-qwen3-vl-235b-a22b-instruct | Self-reported | 2026-05-06 |
| 3 | Qwen3.6-35B-A3B | 0.82 | Qwen3.6 35B A3B qwen-qwen3.6-35b-a3b | Self-reported | 2026-05-06 |
| 4 | Qwen3.5-122B-A10B | 0.82 | Qwen3.5-122B-A10B qwen-qwen3.5-122b-a10b | Self-reported | 2026-05-06 |
| 5 | Qwen3 VL 235B A22B Thinking | 0.81 | Qwen3 VL 235B A22B Thinking qwen-qwen3-vl-235b-a22b-thinking | Self-reported | 2026-05-06 |
| 6 | Qwen3.6-27B | 0.81 | Qwen3.6 27B qwen-qwen3.6-27b | Self-reported | 2026-05-06 |
| 7 | Qwen3.5-27B | 0.81 | Qwen3.5-27B qwen-qwen3.5-27b | Self-reported | 2026-05-06 |
| 8 | Qwen3.5-35B-A3B | 0.81 | Qwen3.5-35B-A3B qwen-qwen3.5-35b-a3b | Self-reported | 2026-05-06 |
| 8 | Qwen3 VL 30B A3B Instruct | 0.81 | Qwen3 VL 30B A3B Instruct qwen-qwen3-vl-30b-a3b-instruct | Self-reported | 2026-05-06 |
| 10 | Qwen3 VL 32B Instruct | 0.80 | Qwen3 VL 32B Instruct qwen-qwen3-vl-32b-instruct | Self-reported | 2026-05-06 |
| 11 | Qwen3 VL 8B Instruct | 0.80 | Qwen3 VL 8B Instruct qwen-qwen3-vl-8b-instruct | Self-reported | 2026-05-06 |
| 12 | Qwen2.5 VL 72B Instruct | 0.80 | Qwen2.5 VL 72B Instruct qwen-qwen2.5-vl-72b-instruct | Self-reported | 2026-05-06 |
| 13 | Qwen2.5 VL 7B Instruct | 0.78 | — | Self-reported | 2026-05-06 |
| 13 | Qwen3 VL 30B A3B Thinking | 0.78 | Qwen3 VL 30B A3B Thinking qwen-qwen3-vl-30b-a3b-thinking | Self-reported | 2026-05-06 |
| 15 | Qwen2.5 VL 32B Instruct | 0.77 | — | Self-reported | 2026-05-06 |
| 16 | Qwen3 VL 8B Thinking | 0.76 | Qwen3 VL 8B Thinking qwen-qwen3-vl-8b-thinking | Self-reported | 2026-05-06 |
| 17 | Qwen3 VL 4B Instruct | 0.76 | — | Self-reported | 2026-05-06 |
| 18 | Qwen3 VL 4B Thinking | 0.74 | — | Self-reported | 2026-05-06 |
No matching rows.