Will an AI system beat humans in the GAIA benchmark before the end of 2025?
11
Ṁ110Ṁ587Jan 1
10%
chance
1H
6H
1D
1W
1M
ALL
GAIA: a benchmark for General AI Assistants
paper: https://arxiv.org/abs/2311.12983
GPT4 scored only 15% compared to 92% for humans
I will resolve based on open source results or official reputable company announcements/papers.
This question is managed and resolved by Manifold.
Market context
Get 
1,000 to start trading!
1,000Sort by:
Good market. A good resolution source might be the average score on the test set https://huggingface.co/spaces/gaia-benchmark/leaderboard
I would be interested in a market that ends at the end of 2029.
People are also trading
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
62% chance
Will an AI achieve >80% performance on the FrontierMath benchmark before 2027?
48% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
35% chance
Will AI beat top Magic the Gathering human player before the end of 2028?
26% chance
By when will AIs perform at least as well as humans on GAIA?
Will AI beat top Magic the Gathering human player before the end of 2026?
18% chance
Will AIs beat human experts in question-answering on the GPQA benchmark before January 1st, 2027?
95% chance
Will an AI system similar to Auto-GPT make a successful attempt to kill a human by 2030?
27% chance
Will AI wipe out AI before the year 2030?
4% chance
In what year will AI achieve a score of 95% or higher on the PhysBench leaderboard?
2036