Will an AI system beat humans in the GAIA benchmark in 2024?
Basic
12
Ṁ809resolved Jan 4
Resolved
NO1D
1W
1M
ALL
GAIA: a benchmark for General AI Assistants
paper: https://arxiv.org/abs/2311.12983
GPT4 scored only 15% compared to 92% for humans
I will resolve based on open source results or official reputable company announcements/papers.
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
@JanProvaznik Resolves as NO. AI Assistants still score much worse than humans:
@mods Resolves as NO. The market creator has been inactive for two months. The resolution should be very clear: GAIA's leaderboard shows AI assistants are still significantly behind humans.
Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
71% chance
Will an AI achieve >30% performance on the FrontierMath benchmark before 2026?
78% chance
Will an AI system beat humans in the GAIA benchmark before the end of 2025?
60% chance
By when will AIs perform at least as well as humans on GAIA?
Will an AI score 1st place on International Math Olympiad (IMO) 2025?
38% chance
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
64% chance
Will an AI be able to play a type of video game that it wasn't trained on before 2026?
42% chance
Will an AI by OpenAI beat a super grandmaster playing chess by 2028?
69% chance
Will AI beat top Magic the Gathering human player before the end of 2028?
50% chance
Will an AI system similar to Auto-GPT make a successful attempt to kill a human by 2030?
28% chance