When will any model achieve >=human performance on QuALITY?
6
680Ṁ4592032
2%
0.9%
Before 2023
0.4%
2023-2024
50%
2024-2025
34%
2025-2026
4%
2026-2027
0.7%
2027-2032
8%
2032-never
QuALITY: https://arxiv.org/pdf/2112.08608.pdf. At time of writing, human performance is 93.5% and this will be used to resolve the question.
Apr 8, 4:25pm: I've written my own answers and will pick whichever one applies. x-y means after x and before y.
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
Sort by:
People are also trading
Related questions
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
61% chance
Will AI image generating models score >= 90% on Winoground by June 1, 2025?
76% chance
Will a single model achieve superhuman performance on all Atari environments by 2025?
22% chance
Will a single model achieve superhuman performance on all OpenAI gym environments by 2025?
25% chance
By 2025 end, a model exhibits action recognition (video) equivalent to human level accuracy on Something Something V2?
60% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
57% chance
Will any AI model score above 95% on GRAB by the end of 2025?
41% chance
Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?
92% chance
Will a GPT-3 quality model be trained for under $1,000 by 2030?
81% chance