VLMsAreBlind

A vision-language benchmark that probes blind spots and brittle reasoning in multimodal models.

4rows
scoreprimary metric
2026-05-06sampled

Metadata

Metrics

Score, Normalized Score

Latest Results

Rank Subject Score Model Match Provenance Sampled
1 Qwen3.5-35B-A3B 0.97 Qwen3.5-35B-A3B
qwen-qwen3.5-35b-a3b
Self-reported 2026-05-06
1 Qwen3.6-27B 0.97 Qwen3.6 27B
qwen-qwen3.6-27b
Self-reported 2026-05-06
3 Qwen3.5-27B 0.97 Qwen3.5-27B
qwen-qwen3.5-27b
Self-reported 2026-05-06
4 Qwen3.5-122B-A10B 0.97 Qwen3.5-122B-A10B
qwen-qwen3.5-122b-a10b
Self-reported 2026-05-06