![](/_next/image?url=https%3A%2F%2Fstorage.googleapis.com%2Fmantic-markets.appspot.com%2Fcontract-images%2FPeterBarnett%2F01ds2lgpyc.jpg&w=3840&q=75)
What will be the human baseline for the Abstraction and Reasoning Corpus (ARC-AGI)?
Basic
16
Ṁ3.0k2027
1D
1W
1M
ALL
4%
0-15%
5%
15-35%
27%
35-60%
25%
60-75%
80%
75-90%
7%
90-100%
There is not currently an established human baseline for François Chollet's Abstraction and Reasoning Corpus (ARC-AGI).
On the public training set humans solve 84% of the tasks.
It it known that the public training set is easier than the public evaluation set and the private evaluation set. The public and private evaluation sets are apparently the roughly the same level of difficulty.
For the first credible human baseline study, what fraction of evaluation set tasks will humans successfully solve?
Note that this can include tasks from either the public or private evaluation sets.
In the extremely unlikely case that the number would fit in two intervals, the lowest will be chosen.
Get Ṁ600 play money
More related questions
Related questions
AI solves the Abstraction and Reasoning Corpus (ARC) by 2028
47% chance
AGI's consensus definition reaches alignment as follows: current tests + new tests in planning+reasoning capabilities
45% chance
AI solves the Abstraction and Reasoning Corpus (ARC) by 2025
11% chance
By when will 85% be reached on the public evaluation set on ARC-AGI-Pub?
What organization will be the first to create AGI?
Will we reach "weak AGI" by the end of 2025?
25% chance
Who Will Be the First to Reveal Human-Level AGI?
In 2029, will any AI be able to construct "reasonably" bug-free code of >= 10k LOC from a natural language specification? (Gary Marcus benchmark #4)
70% chance
In what year will we achieve AGI?
0.00
Will we have an AGI as smart as a "generally educated human" by the end of 2025?
18% chance