ASTA Bench

Allen AI benchmark for scientific discovery agents spanning literature understanding, code execution, data analysis, and end-to-end discovery tasks.

67rows
overallprimary metric
2026-05-06sampled

Metadata

ID
asta_bench
Category
Agentic
Release
2025-08-26

Metrics

Overall Score, Literature Understanding, Code & Execution, Data Analysis, End-to-End Discovery, Tasks Attempted, Categories Attempted

Latest Results

Rows represent public test submissions. Source agent display names are preserved.

Rank Subject Overall Score Model Match Provenance Sampled
1 Asta Scholar QA (w/ Tables) 91.31 — Imported 2026-05-06
2 Asta Scholar QA (w/ Tables) 90 — Imported 2026-05-06
3 Asta Scholar QA 89.43 — Imported 2026-05-06
4 Asta Scholar QA 88.61 — Imported 2026-05-06
5 Asta Scholar QA 88.24 — Imported 2026-05-06
6 SciSpace Deep Review 87.41 — Imported 2026-05-06
7 Elicit 86.63 — Imported 2026-05-06
8 Button 83.56 — Imported 2026-05-06
9 STORM 81.67 — Imported 2026-05-06
10 OpenAI Deep Research 79.40 — Imported 2026-05-06
11 Asta Scholar QA 79.04 — Imported 2026-05-06
12 FutureHouse Crow 78.68 — Imported 2026-05-06
13 FutureHouse Falcon 78.52 — Imported 2026-05-06
14 Perplexity Sonar Deep Research 71.86 — Imported 2026-05-06
15 Asta Paper Finder 65.19 — Imported 2026-05-06
16 EvoScientist-Code 60.20 — Imported 2026-05-06
17 Asta Panda 59.83 — Imported 2026-05-06
18 OpenSciLM 59.46 — Imported 2026-05-06
19 ReAct 59.22 — Imported 2026-05-06
20 ReAct 56.72 — Imported 2026-05-06
21 ReAct 55.90 — Imported 2026-05-06
22 ReAct 54.18 — Imported 2026-05-06
23 Asta CodeScientist 52.73 — Imported 2026-05-06
24 Asta v0 51.79 — Imported 2026-05-06
25 ReAct 51.01 — Imported 2026-05-06
26 ReAct 47.79 — Imported 2026-05-06
27 ReAct 44.70 — Imported 2026-05-06
28 Asta Paper Finder 43.27 — Imported 2026-05-06
29 Asta Table Synthesis 42.61 — Imported 2026-05-06
30 Asta Table Synthesis 41.71 — Imported 2026-05-06
31 Asta Table Synthesis 41.62 — Imported 2026-05-06
32 ReAct 38.88 — Imported 2026-05-06
33 Asta Table Synthesis 38.81 — Imported 2026-05-06
34 ReAct 38.04 — Imported 2026-05-06
35 Asta Table Synthesis 37.21 — Imported 2026-05-06
36 Smolagents Coder 36.24 — Imported 2026-05-06
37 Asta Table Synthesis 35.38 — Imported 2026-05-06
38 Smolagents Coder 35.34 — Imported 2026-05-06
39 You.com Research API 34.40 — Imported 2026-05-06
40 Asta Table Synthesis 34.37 — Imported 2026-05-06
41 EvoScientist Coder 34.33 — Imported 2026-05-06
42 ReAct 32.79 — Imported 2026-05-06
43 ReAct 31.65 — Imported 2026-05-06
44 Asta DataVoyager 31.13 — Imported 2026-05-06
45 Asta Table Synthesis 31.06 — Imported 2026-05-06
46 Smolagents Coder 30.67 — Imported 2026-05-06
47 Asta Panda 30.31 — Imported 2026-05-06
48 Asta DataVoyager 29.88 — Imported 2026-05-06
49 Asta DataVoyager 29.56 — Imported 2026-05-06
50 Smolagents Coder 27.57 — Imported 2026-05-06
51 Asta DataVoyager 27.04 — Imported 2026-05-06
52 Asta Table Synthesis 26.36 — Imported 2026-05-06
53 Asta DataVoyager 25.72 — Imported 2026-05-06
54 Smolagents Coder 24.64 — Imported 2026-05-06
55 ReAct 21.90 — Imported 2026-05-06
56 You.com Search API 21.60 — Imported 2026-05-06
57 ReAct 16.80 — Imported 2026-05-06
58 Asta Code 16.25 — Imported 2026-05-06
59 ReAct 15.94 — Imported 2026-05-06
60 Faker 14.72 — Imported 2026-05-06
61 Asta Code 13.51 — Imported 2026-05-06
62 Asta Code 12.83 — Imported 2026-05-06
63 Smolagents Coder 12.81 — Imported 2026-05-06
64 Smolagents Coder 11.78 — Imported 2026-05-06
65 Smolagents Coder 11.14 — Imported 2026-05-06
66 ReAct 8.70 — Imported 2026-05-06
67 Asta Code 5.56 — Imported 2026-05-06