Spider 2.0

Enterprise text-to-SQL workflow benchmark over BigQuery, Snowflake, DBT, and realistic database engineering tasks.

113rows
scoreprimary metric
2026-05-27sampled

Metadata

ID
spider_2_0
Category
Data
Release
Unknown

Metrics

Score

Showing 3 latest source slices.

Latest Results

Rows parsed from the public Spider 2.0 leaderboard. Rows marked with -* by the source use special settings such as ground-truth tables and are flagged in metadata.

Rank Subject Score Model Match Provenance Sampled
1 Databao Agent 60.29 — Imported 2026-05-27
2 SignalPilot Agent 51.56 — Imported 2026-05-27
3 Shadowfax-DBT-Agent + GPT-5 41.18 — Imported 2026-05-27
4 Spider-Agent-Extended + GPT-5 39.71 — Imported 2026-05-27
5 Symbiote Agent + GPT-5 35.29 — Imported 2026-05-27
6 Spider-Agent-DBT + GPT-5.4 35.29 — Imported 2026-05-27
7 Chicory AI Agent + Claude Sonnet 4.5 35.29 — Imported 2026-05-27
8 DAQUV_QUVI_Agent 17.65 — Imported 2026-05-27
9 Spider-Agent + Claude-3.7-Sonnet-20250219 14.70 — Imported 2026-05-27
10 Spider-Agent + o1-preview 13.24 — Imported 2026-05-27
11 Spider-Agent + GPT-4.1 10.29 — Imported 2026-05-27
12 Spider-Agent + GPT-4o 7.35 — Imported 2026-05-27
13 Spider-Agent + o3-mini 4.41 — Imported 2026-05-27
14 Spider-Agent + o3 2.94 — Imported 2026-05-27
1 DivSkill-SQL 73.13 — Imported 2026-05-27
2 SOMA-SQL 72.02 — Imported 2026-05-27
3 DecisionX Agent 71.84 — Imported 2026-05-27
4 Databao Agent 69.65 — Imported 2026-05-27
5 QUVI-2.3 + Claude-Opus-4.5 65.81 — Imported 2026-05-27
6 EXA-SQL 64.16 — Imported 2026-05-27
7 Claude Code Agent + Sonnet 61.2 — Imported 2026-05-27
8 ProSPy: Profiling-driven SQL-Python Analysis Framework + Claude-4.5-Opus 60.15 — Imported 2026-05-27
9 ReFoRCE + o3 55.21 — Imported 2026-05-27
10 CoFD-SQL + GPT-5 54.66 — Imported 2026-05-27
11 CT-ChatBI + o4-mini 53.02 — Imported 2026-05-27
12 AutoLink + Deepseek-R1 52.28 — Imported 2026-05-27
13 GRASP + Reforce + Gemini-3-Flash + DeepSeek-V3.2 51.31 — Imported 2026-05-27
14 DSR-SQL + DeepSeek-R1-0528 + DeepSeek-V3.2 46.80 — Imported 2026-05-27
15 AgenticData + Qwen3 44.5 — Imported 2026-05-27
16 Spider-Agent + Claude-Sonnet-4.5 41.86 — Imported 2026-05-27
17 ReFoRCE + Qwen3 35.6 — Imported 2026-05-27
18 RSL-SQL + o3 33.09 — Imported 2026-05-27
19 LinkAlign + DeepSeek-R1 33.09 — Imported 2026-05-27
20 YAN-Agent + GLM-5 32.36 — Imported 2026-05-27
21 RSL-SQL + DeepSeek-R1 30.53 — Imported 2026-05-27
22 ReFoRCE + o1-preview 30.35 — Imported 2026-05-27
23 Spider-Agent + Claude-3.7-Sonnet-20250219-Thinking 28.52 — Imported 2026-05-27
24 Spider-Agent + Claude-4-Sonnet-20250514 27.79 — Imported 2026-05-27
25 RSL-SQL + DeepSeek-V3 26.14 — Imported 2026-05-27
26 Spider-Agent + Claude-3.7-Sonnet-20250219 25.41 — Imported 2026-05-27
27 LinkAlign + DeepSeek-V3 24.86 — Imported 2026-05-27
28 Spider-Agent + o3-mini-2025-01-31 23.40 — Imported 2026-05-27
29 Spider-Agent + o1-preview 23.03 — Imported 2026-05-27
30 AI-DIVE + gpt-oss-120B 21.9 — Imported 2026-05-27
31 Spider-Agent + DeepSeek-R1 13.71 — Imported 2026-05-27
32 Spider-Agent + GPT-4o-2024-11-20 13.16 — Imported 2026-05-27
33 Spider-Agent + QwQ-32B 11.33 — Imported 2026-05-27
34 Duo 8.96 — Imported 2026-05-27
35 Spider-Agent + Claude-3.5-Sonnet-20240620 8.32 — Imported 2026-05-27
36 Spider-Agent + Qwen2.5-Coder-32B-Instruct 5.85 — Imported 2026-05-27
37 DailSQL + GPT-4o 5.68 — Imported 2026-05-27
38 CHESS + GPT-4o 3.84 — Imported 2026-05-27
39 DIN-SQL + GPT-4o 1.46 — Imported 2026-05-27
40 SFT CodeS-15B 0.73 — Imported 2026-05-27
1 Genloop's Sentinel Agent v2 Pro 96.70 — Imported 2026-05-27
2 Native mini 96.53 — Imported 2026-05-27
3 QUVI-3 + Gemini-3-pro-preview 94.15 — Imported 2026-05-27
4 TCDataAgent-SQL with Contextual Scaling Engine 93.97 — Imported 2026-05-27
5 Prism Swarm with Deepthink + Claude-Sonnet-4.5 90.49 — Imported 2026-05-27
6 Genloop's Sentinel Agent v2 88.48 — Imported 2026-05-27
7 QUVI-3 + Claude-Opus-4.6 86.28 — Imported 2026-05-27
8 Ask Data with Relational Knowledge Graph 86.28 — Imported 2026-05-27
9 ByteBrain-Agent 84.10 — Imported 2026-05-27
10 Genloop's Sentinel Agent v1.5 83.36 — Imported 2026-05-27
11 Deepinsight Agent 83.00 — Imported 2026-05-27
12 AiCheng Agent 82.81 — Imported 2026-05-27
13 Prism Swarm + Claude-Sonnet-4.5 82.63 — Imported 2026-05-27
14 LingXi Agent + Claude-Sonnet-4.5 79.89 — Imported 2026-05-27
15 Arctic-FLEX 75.14 — Imported 2026-05-27
16 Sophon-Agent 74.04 — Imported 2026-05-27
17 APEX-SQL 73.13 — Imported 2026-05-27
18 QiSi-SQL + Deepseek3.2 70.38 — Imported 2026-05-27
19 PExA 70.20 — Imported 2026-05-27
20 Chicory AI Agent + Claude Sonnet 4.5 + Opus 4.5 Judge 67.28 — Imported 2026-05-27
21 SSDAT + GPT-5 65.63 — Imported 2026-05-27
22 FlexSQL + gpt-oss-120b 65.45 — Imported 2026-05-27
23 DSR-SQL + DeepSeek-R1 63.80 — Imported 2026-05-27
24 ReFoRCE + o3 62.89 — Imported 2026-05-27
25 WindAgent + Claude-4-Sonnet 61.43 — Imported 2026-05-27
26 PAI-DataSurfer Agent 60.33 — Imported 2026-05-27
27 DSR-SQL (w/o voting) + Kimi K2.5 55.94 — Imported 2026-05-27
28 AutoLink + DeepSeek-R1 54.84 — Imported 2026-05-27
29 PGV-Agent + GLM-5 50.27 — Imported 2026-05-27
30 Meituan-agent 45.34 — Imported 2026-05-27
31 KDGCCloud-KCILab + Qwen3-Max 45.15 — Imported 2026-05-27
32 AgenticView + GPT-5-mini 40.95 — Imported 2026-05-27
33 CT-ChatBI + Qwen3-Max 40.40 — Imported 2026-05-27
34 Chat2DB-Agent + Claude-4-Sonnet 38.39 — Imported 2026-05-27
35 ReFoRCE + DeepSeek-V3 38.03 — Imported 2026-05-27
36 Spider-Agent + Qwen3-Coder-Plus 37.80 — Imported 2026-05-27
37 ReFoRCE + o1-preview 31.26 — Imported 2026-05-27
38 Spider-Agent + Qwen3-Coder 31.08 — Imported 2026-05-27
39 Spider-Agent + Claude-4-Sonnet-20250514 25.78 — Imported 2026-05-27
40 Spider-Agent + Claude-3.7-Sonnet-20250219 24.50 — Imported 2026-05-27
41 Spider-Agent + Claude-3.7-Sonnet-20250219-Thinking 24.31 — Imported 2026-05-27
42 Spider-Agent + o1-preview 23.58 — Imported 2026-05-27
43 Spider-Agent + o1-2024-12-17 23.21 — Imported 2026-05-27
44 Spider-Agent + o3-mini-2025-01-31 19.20 — Imported 2026-05-27
45 Spider-Agent + Claude-3.5-Sonnet-20241022 19.01 — Imported 2026-05-27
46 Spider-Agent + Claude-3.5-Sonnet-20241022 15.54 — Imported 2026-05-27
47 Spider-Agent + Gemini-2.0-Pro 13.89 — Imported 2026-05-27
48 AI-DIVE + gpt-oss-120B 13.1 — Imported 2026-05-27
49 Spider-Agent + GPT-4o-2024-11-20 12.98 — Imported 2026-05-27
50 Spider-Agent + GPT-4o-2024-08-06 10.79 — Imported 2026-05-27
51 Spider-Agent + DeepSeek-R1 10.55 — Imported 2026-05-27
52 CollideNL2SQL + GPT-4o 9.68 — Imported 2026-05-27
53 Spider-Agent + QwQ-32B 8.96 — Imported 2026-05-27
54 Spider-Agent + DeepSeek-V3 8.78 — Imported 2026-05-27
55 Spider-Agent + Qwen2.5-Coder-32B-Instruct 5.48 — Imported 2026-05-27
56 Dail-SQL + GPT-4o 2.20 — Imported 2026-05-27
57 CHESS + GPT-4o 1.28 — Imported 2026-05-27
58 DIN-SQL + GPT-4o 0.00 — Imported 2026-05-27
59 SFT CodeS-15B 0.00 — Imported 2026-05-27