When will any model achieve >=human performance on QuALITY?
6
680Ṁ4592032
2%
0.9%
Before 2023
0.4%
2023-2024
50%
2024-2025
34%
2025-2026
4%
2026-2027
0.7%
2027-2032
8%
2032-never
QuALITY: https://arxiv.org/pdf/2112.08608.pdf. At time of writing, human performance is 93.5% and this will be used to resolve the question.
Apr 8, 4:25pm: I've written my own answers and will pick whichever one applies. x-y means after x and before y.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000Sort by:
People are also trading
Related questions
Will any model get above human level on the Simple Bench benchmark before September 1st, 2025.
41% chance
Will a single model achieve superhuman performance on all Atari environments by 2025?
22% chance
Will a single model achieve superhuman performance on all OpenAI gym environments by 2025?
25% chance
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
By 2025 end, a model exhibits action recognition (video) equivalent to human level accuracy on Something Something V2?
60% chance
Will an AI model outperform 95% of Manifold users on accuracy before 2026?
49% chance
Will any AI model score above 95% on GRAB by the end of 2025?
40% chance
Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?
92% chance
By 2026 will any RL agent with learned causal models of its environment achieve superhuman performance on >=10 Atari environments?
81% chance
Benchmark Gap #3: Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 2 years before there are "entry level" AI programmers in industry use?
73% chance