By when will 85% be reached on the public evaluation set on ARC-AGI-Pub?
Premium
58
Ṁ47k2030
7%
01/01/2025
90%
01/01/2026
91%
01/01/2028
92%
01/01/2030
See https://arcprize.org/arc-agi-pub.
This allows for arbitrary API usage unlike the ARC-AGI prize.
I will resolve based on when the date when the method is first reported even if it is not submitted until substantially later (due to e.g. no public API).
I will apply a restriction roughly in line with the $10,000 runtime cost contraint, though it is unclear how this should resolve with respect to private models with no known API price.
I will exclude solutions that seem heavily overfit based on the semi-private evaluation set.
(Cut off data is resolved based on midnight PT.)
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
Related questions
Related questions
Will the ARC-AGI grand prize (v1, 2024 dataset) be claimed by end of 2025?
54% chance
Will we get AGI before 2028?
45% chance
Will we get AGI before 2025?
1% chance
Will GPT4/Opus report >50% score on ARC in 2024?
13% chance
Will we reach "weak AGI" by the end of 2025?
41% chance
AI solves the Abstraction and Reasoning Corpus (ARC) by 2028
64% chance
Will we get AGI before 2028?
23% chance
Will a Grok AI get >90% on ARC in 2024?
4% chance
In what year will we achieve AGI?
Will the ARC AGI Grand Prize be claimed before 2027?
78% chance