Will an LLM report >50% score on ARC in 2025?
19
1kṀ3984Dec 31
85%
chance
1H
6H
1D
1W
1M
ALL
ARC is a general-purpose AI eval designed to test intelligence as opposed to memorization. https://arcprize.org/arc
This market resolves to Yes if there are public demonstrations of general-purpose base models from OpenAI, Anthropic or Deepmind that solve at least 50% of the ARC questions before 2026.
(note that this is separate from winning the arc price, which requires only using open-source models)
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will LLMs Daydream by EOY 2026?
20% chance
LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?
60% chance
Will there be an LLM which scores above what a human can do in 2 hours on METR's eval suite before 2026?
70% chance
Will an LLM improve its own ability along some important metric well beyond the best trained LLMs before 2026?
50% chance
Will China have the best LLM by the end of 2025?
14% chance
Will an LLM be able to solve the Self-Referential Aptitude Test before 2027?
66% chance
Will LLMs mostly overcome the Reversal Curse by the end of 2025?
59% chance
What will be true of Anthropic's best LLM by EOY 2025?
ARC-AGI-2 Top Score >=50% in 2025?
17% chance
Will RL work for LLMs "spill over" to the rest of RL by 2026?
34% chance