
Will the winner of the ARC Kaggle competition solve at least 50% of the tasks
26
1kṀ11kresolved Nov 5
Resolved
YES1H
6H
1D
1W
1M
ALL
Will any team on the leaderboard of the ARC Kaggle Challenge solve at least 50% of the tasks by the end of the contest without being disqualified?
Details:
Challenge Overview: ARC is hosting a Kaggle Challenge with a grand prize of $1,000,000 for solving more than 85% of the problems.
Current Performance: The best model on the ARC prize website currently achieves a 34% success rate, while human performance is around 85%.
Resolution Criteria: This market resolves to YES if, by the end of the contest, any team on the leaderboard that has not been disqualified solves at least 50% of the tasks. Otherwise, it resolves to NO.
For more information, visit:
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
🏅 Top traders
# | Name | Total profit |
---|---|---|
1 | Ṁ507 | |
2 | Ṁ247 | |
3 | Ṁ219 | |
4 | Ṁ150 | |
5 | Ṁ108 |
People are also trading
Related questions
Will the ARC-AGI grand prize (v1, 2024 dataset) be claimed by end of 2025?
10% chance
Most successful approach in 2025 ARC Prize competition
Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?
28% chance
Will the ARC Prize Foundation succeed at making a new benchmark that is easy for humans but still hard for the best AIs?
88% chance
Will an AI win Advent of Code? (2025)
45% chance
When will a single model first achieve 10@k solve rate >= 90% on the CodeContests dataset?
Will *any* remaining Millenium Prize problem be solved entirely or mostly by humans?
53% chance
Will AI pass the Winograd schema challenge by the end of 2025?
86% chance
Will AI solve 100% of solvable MTurk problems by July 2028?
32% chance
When will AI be able to solve 50% of official Jane Street puzzles?