CC-OCR

A comprehensive OCR benchmark for evaluating Large Multimodal Models (LMMs) in literacy. Comprises four OCR-centric tracks: multi-scene text reading, multilingual text reading, document parsing, and key information extraction. Contains 39 subsets with 7,058 fully annotated images, 41% sourced from real applications. Tests capabilities including text grounding, multi-orientation text recognition, and detecting hallucination/repetition across diverse visual challenges.

18rows
scoreprimary metric
2026-05-06sampled

Metadata

Metrics

Score, Normalized Score

Latest Results

Rank Subject Score Model Match Provenance Sampled
1 Qwen3.6 Plus 0.83 Qwen3.6 Plus
qwen-qwen3.6-plus
Self-reported 2026-05-06
2 Qwen3 VL 235B A22B Instruct 0.82 Qwen3 VL 235B A22B Instruct
qwen-qwen3-vl-235b-a22b-instruct
Self-reported 2026-05-06
3 Qwen3.6-35B-A3B 0.82 Qwen3.6 35B A3B
qwen-qwen3.6-35b-a3b
Self-reported 2026-05-06
4 Qwen3.5-122B-A10B 0.82 Qwen3.5-122B-A10B
qwen-qwen3.5-122b-a10b
Self-reported 2026-05-06
5 Qwen3 VL 235B A22B Thinking 0.81 Qwen3 VL 235B A22B Thinking
qwen-qwen3-vl-235b-a22b-thinking
Self-reported 2026-05-06
6 Qwen3.6-27B 0.81 Qwen3.6 27B
qwen-qwen3.6-27b
Self-reported 2026-05-06
7 Qwen3.5-27B 0.81 Qwen3.5-27B
qwen-qwen3.5-27b
Self-reported 2026-05-06
8 Qwen3.5-35B-A3B 0.81 Qwen3.5-35B-A3B
qwen-qwen3.5-35b-a3b
Self-reported 2026-05-06
8 Qwen3 VL 30B A3B Instruct 0.81 Qwen3 VL 30B A3B Instruct
qwen-qwen3-vl-30b-a3b-instruct
Self-reported 2026-05-06
10 Qwen3 VL 32B Instruct 0.80 Qwen3 VL 32B Instruct
qwen-qwen3-vl-32b-instruct
Self-reported 2026-05-06
11 Qwen3 VL 8B Instruct 0.80 Qwen3 VL 8B Instruct
qwen-qwen3-vl-8b-instruct
Self-reported 2026-05-06
12 Qwen2.5 VL 72B Instruct 0.80 Qwen2.5 VL 72B Instruct
qwen-qwen2.5-vl-72b-instruct
Self-reported 2026-05-06
13 Qwen2.5 VL 7B Instruct 0.78 Self-reported 2026-05-06
13 Qwen3 VL 30B A3B Thinking 0.78 Qwen3 VL 30B A3B Thinking
qwen-qwen3-vl-30b-a3b-thinking
Self-reported 2026-05-06
15 Qwen2.5 VL 32B Instruct 0.77 Self-reported 2026-05-06
16 Qwen3 VL 8B Thinking 0.76 Qwen3 VL 8B Thinking
qwen-qwen3-vl-8b-thinking
Self-reported 2026-05-06
17 Qwen3 VL 4B Instruct 0.76 Self-reported 2026-05-06
18 Qwen3 VL 4B Thinking 0.74 Self-reported 2026-05-06