VideoMME w/o sub.

Video-MME is a comprehensive evaluation benchmark for multi-modal large language models in video analysis. It features 900 videos across 6 primary visual domains with 30 subfields, ranging from 11 seconds to 1 hour in duration, with 2,700 question-answer pairs. The benchmark evaluates MLLMs' capabilities in processing sequential visual data and multi-modal content including video frames, subtitles, and audio.

10rows
scoreprimary metric
2026-05-06sampled

Metadata

Metrics

Score, Normalized Score

Latest Results

Rank Subject Score Model Match Provenance Sampled
1 Qwen3.5-122B-A10B 0.84 Qwen3.5-122B-A10B
qwen-qwen3.5-122b-a10b
Self-reported 2026-05-06
2 Qwen3.5-27B 0.83 Qwen3.5-27B
qwen-qwen3.5-27b
Self-reported 2026-05-06
3 Qwen3.6-35B-A3B 0.82 Qwen3.6 35B A3B
qwen-qwen3.6-35b-a3b
Self-reported 2026-05-06
3 Qwen3.5-35B-A3B 0.82 Qwen3.5-35B-A3B
qwen-qwen3.5-35b-a3b
Self-reported 2026-05-06
5 Qwen3 VL 235B A22B Instruct 0.79 Qwen3 VL 235B A22B Instruct
qwen-qwen3-vl-235b-a22b-instruct
Self-reported 2026-05-06
6 Qwen3 VL 235B A22B Thinking 0.79 Qwen3 VL 235B A22B Thinking
qwen-qwen3-vl-235b-a22b-thinking
Self-reported 2026-05-06
7 Qwen3 VL 32B Thinking 0.77 Self-reported 2026-05-06
8 Qwen2.5 VL 72B Instruct 0.73 Qwen2.5 VL 72B Instruct
qwen-qwen2.5-vl-72b-instruct
Self-reported 2026-05-06
9 Qwen2.5 VL 32B Instruct 0.70 Self-reported 2026-05-06
10 Qwen2.5 VL 7B Instruct 0.65 Self-reported 2026-05-06