![](/_next/image?url=https%3A%2F%2Fstorage.googleapis.com%2Fmantic-markets.appspot.com%2Fcontract-images%2FRyanGreenblatt%2Fn6p51drfpq.jpg&w=3840&q=75)
By when will 85% be reached on the public evaluation set on ARC-AGI-Pub?
Plus
21
Ṁ4.0k2030
1D
1W
1M
ALL
35%
01/01/2025
58%
01/01/2026
67%
01/01/2028
75%
01/01/2030
See https://arcprize.org/arc-agi-pub.
This allows for arbitrary API usage unlike the ARC-AGI prize.
I will resolve based on when the date when the method is first reported even if it is not submitted until substantially later (due to e.g. no public API).
I will apply a restriction roughly in line with the $10,000 runtime cost contraint, though it is unclear how this should resolve with respect to private models with no known API price.
I will exclude solutions that seem heavily overfit based on the semi-private evaluation set.
(Cut off data is resolved based on midnight PT.)
Get Ṁ600 play money
Related questions
Will the ARC-AGI grand prize be claimed by end of 2025?
41% chance
Will we get AGI before 2028?
33% chance
Will we get AGI before 2027?
19% chance
Will we get AGI before 2029?
42% chance
Will GPT4/Opus report >50% score on ARC in 2024?
65% chance
Will at least 30% of Manifold respondents agree that weak AGI had been achieved before July 23, 2024?
16% chance
Will we reach "weak AGI" by the end of 2025?
26% chance
AI solves the Abstraction and Reasoning Corpus (ARC) by 2028
47% chance
What will be the human baseline for the Abstraction and Reasoning Corpus (ARC-AGI)?
Will AGI be achieved in the next 5 years?
32% chance