Will the winner of the ARC Kaggle competition solve at least 50% of the tasks
26
1kṀ11k
resolved Nov 5
Resolved
YES

Will any team on the leaderboard of the ARC Kaggle Challenge solve at least 50% of the tasks by the end of the contest without being disqualified?

Details:

  • Challenge Overview: ARC is hosting a Kaggle Challenge with a grand prize of $1,000,000 for solving more than 85% of the problems.

  • Current Performance: The best model on the ARC prize website currently achieves a 34% success rate, while human performance is around 85%.

  • Resolution Criteria: This market resolves to YES if, by the end of the contest, any team on the leaderboard that has not been disqualified solves at least 50% of the tasks. Otherwise, it resolves to NO.

For more information, visit:

AI
Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ507
2Ṁ247
3Ṁ219
4Ṁ150
5Ṁ108

People are also trading

Will an unsolved millenium prize problem be solved by AI by the end of 2028
20% chance
Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?
8% chance
Will the ARC-AGI grand prize (v1, 2024 dataset) be claimed by end of 2025?
3% chance
Will AI pass the Winograd schema challenge by the end of 2025?
39% chance
When will a single model first achieve 10@k solve rate >= 90% on the CodeContests dataset?
Will AI solve 100% of solvable MTurk problems by July 2028?
32% chance
When will AI be able to solve 50% of official Jane Street puzzles?
Will *any* remaining Millenium Prize problem be solved entirely or mostly by humans?
64% chance
Which AI lab will be the first to solve a millennium prize problem?
Which AI company first solves FrontierMath 85%?
Sort by:

Mind fixing the title? Should be at least 50% not more than 50%

@Usaar33 Fixed :)

bought Ṁ300 YES

They plan to run the contest yearly until an open source submission gets 85%. I assume this question is about this year?

Yes, the currently running competition, which will close submissions in 5 months.

@jskf "yearly" 😂 I doubt this contest will run many years... Just one more would surprise me

@RationalHippy yeah, the top score is currently very close to the 50%, but still far away from the 85% where arc is considered "solved"

But I cannot imagine it will take much longer to get there

People are also trading

Will an unsolved millenium prize problem be solved by AI by the end of 2028
-4% 1d20% chance
Will any AI solve more than four of AI 2027 Marcus-Brundage tasks in 2025?
8% chance
Will the ARC-AGI grand prize (v1, 2024 dataset) be claimed by end of 2025?
3% chance
Will AI pass the Winograd schema challenge by the end of 2025?
39% chance
When will a single model first achieve 10@k solve rate >= 90% on the CodeContests dataset?
Will AI solve 100% of solvable MTurk problems by July 2028?
32% chance
When will AI be able to solve 50% of official Jane Street puzzles?
Will *any* remaining Millenium Prize problem be solved entirely or mostly by humans?
64% chance
Which AI lab will be the first to solve a millennium prize problem?
Which AI company first solves FrontierMath 85%?
© Manifold Markets, Inc.•Terms•Privacy