When will any model achieve >=human performance on QuALITY?
6
680Ṁ4592032
2%
0.9%
Before 2023
0.4%
2023-2024
50%
2024-2025
34%
2025-2026
4%
2026-2027
0.7%
2027-2032
8%
2032-never
QuALITY: https://arxiv.org/pdf/2112.08608.pdf. At time of writing, human performance is 93.5% and this will be used to resolve the question.
Apr 8, 4:25pm: I've written my own answers and will pick whichever one applies. x-y means after x and before y.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000People are also trading
Related questions
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
42% chance
Will a single model achieve superhuman performance on all Atari environments by 2025?
22% chance
Will a single model achieve superhuman performance on all OpenAI gym environments by 2025?
25% chance
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
By 2025 end, a model exhibits action recognition (video) equivalent to human level accuracy on Something Something V2?
60% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
46% chance
Will any AI model score above 95% on GRAB by the end of 2025?
40% chance
Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?
92% chance
By 2026 will any RL agent with learned causal models of its environment achieve superhuman performance on >=10 Atari environments?
81% chance
Benchmark Gap #3: Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 2 years before there are "entry level" AI programmers in industry use?
73% chance