Clembench Multimodal v1.6.5

Metadata

ID

clembench_multimodal_v1_6_5

Category

Agentic

Release

2024-01-01

Source

Source page

Snapshot

Snapshot source

Metrics

clemscore, all Average % Played, all Average Quality Score, matchit % Played, matchit Quality Score, matchit Quality Score (std), mm_mapworld % Played, mm_mapworld Quality Score, mm_mapworld Quality Score (std), mm_mapworld_graphs % Played, mm_mapworld_graphs Quality Score, mm_mapworld_graphs Quality Score (std), mm_mapworld_specificroom % Played, mm_mapworld_specificroom Quality Score, mm_mapworld_specificroom Quality Score (std), multimodal_referencegame % Played, multimodal_referencegame Quality Score, multimodal_referencegame Quality Score (std)