Will an AI system beat humans in the GAIA benchmark in 2024?
9
68
Ṁ130Ṁ190
2025
20%
chance
1D
1W
1M
ALL
GAIA: a benchmark for General AI Assistants
paper: https://arxiv.org/abs/2311.12983
GPT4 scored only 15% compared to 92% for humans
I will resolve based on open source results or official reputable company announcements/papers.
Get Ṁ600 play money
Related questions
In 2028, will an AI be able to play randomly-selected computer games at human level, given the chance to train via self-play?
66% chance
In 2028, will an AI be able to play randomly selected computer games at human level without getting to practice?
34% chance
Will an AI be able to speedrun any popular video game faster than the human WR by the end of 2024?
29% chance
Will an AI by OpenAI beat a super grandmaster playing chess by 2028?
53% chance
Will an AI system beat humans in the GAIA benchmark before the end of 2025?
49% chance
When will AI be better than humans at AI research? (Basically AGI)
By when will AIs perform at least as well as humans on GAIA?
Will an AI-first operating system be released in 2024?
33% chance
Will AI reach human-level performance in Magic: The Gathering before 2026?
54% chance
Will general purpose AI models beat average score of human players in Diplomacy by 2028?
60% chance