AI solves the Abstraction and Reasoning Corpus (ARC) by 2028
Basic
53
6.0k
2027
47%
chance

A machine program or model solves 100% of the ARC evaluation questions without it having any contact with those questions prior to the first and only trial to answer. The set of questions must include all the 400 public evaluation questions and either at least 50 private evaluation questions available in something like the ARCathon (https://lab42.global/arcathon/) or at least 50 questions of similar kind and difficulty created after the program. Must be achieved by the end of 2027 (31st December). Questions and details about ARC here: https://github.com/fchollet/ARC

Market with the same resolution criteria but timeline is before 2025:

https://manifold.markets/MGM/ai-solves-the-abstraction-and-reaso

Get Ṁ600 play money
Sort by:
bought Ṁ50 NO

Seems unlikely that 100% is achievable because of label noise. I don't think they got multiple (aside from ARC devs) people to answer all of the evaluation questions.

opened a Ṁ1,000 NO at 50% order

Yes, extremely unlikely. No major academic benchmark to date has gotten close to 100%. Not GSM8k, not MMLU, not Hendrycks MATH. This isn't happening.

Linking in some related markets: