olmOCR-bench

Document OCR benchmark from AllenAI for measuring OCR model quality on varied real-world document pages.

25rows
scoreprimary metric
2026-05-06sampled

Metadata

ID
olmocr_bench
Category
Multimodal
Release
2025-02-25

Metrics

Score

Latest Results

Rows are ranked by the benchmark score column. Model display names are preserved from the OpenEvals source dataset.

Rank Subject Score Model Match Provenance Sampled
1 datalab-to/chandra-ocr-2 85.90 — Imported 2026-05-06
2 rednote-hilab/dots.mocr 83.90 — Imported 2026-05-06
3 mlx-community/dots.mocr-4bit 83.90 — Imported 2026-05-06
4 mlx-community/dots.mocr-5bit 83.90 — Imported 2026-05-06
5 mlx-community/dots.mocr-6bit 83.90 — Imported 2026-05-06
6 mlx-community/dots.mocr-8bit 83.90 — Imported 2026-05-06
7 mlx-community/dots.mocr-bf16 83.90 — Imported 2026-05-06
8 mlx-community/dots.mocr-mxfp4 83.90 — Imported 2026-05-06
9 mlx-community/dots.mocr-mxfp8 83.90 — Imported 2026-05-06
10 mlx-community/dots.mocr-nvfp4 83.90 — Imported 2026-05-06
11 lightonai/LightOnOCR-2-1B 83.20 — Imported 2026-05-06
12 datalab-to/chandra 83.10 — Imported 2026-05-06
13 infly/Infinity-Parser-7B 82.50 — Imported 2026-05-06
14 allenai/olmOCR-2-7B-1025-FP8 82.40 — Imported 2026-05-06
15 TitanML/olmOCR-2-7B-1025-FP8 82.40 — Imported 2026-05-06
16 PaddlePaddle/PaddleOCR-VL 80 — Imported 2026-05-06
17 baidu/Qianfan-OCR 79.80 — Imported 2026-05-06
18 rednote-hilab/dots.ocr 79.10 — Imported 2026-05-06
19 deepseek-ai/DeepSeek-OCR-2 76.30 — Imported 2026-05-06
20 lightonai/LightOnOCR-1B-1025 76.10 — Imported 2026-05-06
21 deepseek-ai/DeepSeek-OCR 75.70 — Imported 2026-05-06
22 opendatalab/MinerU2.5-2509-1.2B 75.20 — Imported 2026-05-06
23 zai-org/GLM-OCR 75.20 — Imported 2026-05-06
24 FireRedTeam/FireRed-OCR 70.20 — Imported 2026-05-06
25 nanonets/Nanonets-OCR2-3B 69.50 — Imported 2026-05-06