CharadesSTA

Charades-STA is a benchmark dataset for temporal activity localization via language queries, extending the Charades dataset with sentence temporal annotations. It contains 12,408 training and 3,720 testing segment-sentence pairs from videos with natural language descriptions and precise temporal boundaries for localizing activities based on language queries.

12rows
scoreprimary metric
2026-05-06sampled

Metadata

Metrics

Score, Normalized Score

Latest Results

Rank Subject Score Model Match Provenance Sampled
1 Qwen3 VL 235B A22B Instruct 0.65 Qwen3 VL 235B A22B Instruct
qwen-qwen3-vl-235b-a22b-instruct
Self-reported 2026-05-06
2 Qwen3 VL 235B A22B Thinking 0.64 Qwen3 VL 235B A22B Thinking
qwen-qwen3-vl-235b-a22b-thinking
Self-reported 2026-05-06
2 Qwen3 VL 30B A3B Instruct 0.64 Qwen3 VL 30B A3B Instruct
qwen-qwen3-vl-30b-a3b-instruct
Self-reported 2026-05-06
4 Qwen3 VL 32B Thinking 0.63 Self-reported 2026-05-06
5 Qwen3 VL 30B A3B Thinking 0.63 Qwen3 VL 30B A3B Thinking
qwen-qwen3-vl-30b-a3b-thinking
Self-reported 2026-05-06
6 Qwen3 VL 32B Instruct 0.61 Qwen3 VL 32B Instruct
qwen-qwen3-vl-32b-instruct
Self-reported 2026-05-06
7 Qwen3 VL 8B Thinking 0.60 Qwen3 VL 8B Thinking
qwen-qwen3-vl-8b-thinking
Self-reported 2026-05-06
8 Qwen3 VL 4B Thinking 0.59 Self-reported 2026-05-06
9 Qwen3 VL 8B Instruct 0.56 Qwen3 VL 8B Instruct
qwen-qwen3-vl-8b-instruct
Self-reported 2026-05-06
10 Qwen3 VL 4B Instruct 0.56 Self-reported 2026-05-06
11 Qwen2.5 VL 32B Instruct 0.54 Self-reported 2026-05-06
12 Qwen2.5 VL 7B Instruct 0.44 Self-reported 2026-05-06