HumanEval 90% #3: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2026?
8
190Ṁ367resolved Jun 10
Resolved
YES1H
6H
1D
1W
1M
ALL
Benchmark link: https://paperswithcode.com/sota/code-generation-on-humaneval
pass@1 means the model gets a single attempt.
This question is managed and resolved by Manifold.
Get 
1,000 to start trading!
1,000🏅 Top traders
| # | Name | Total profit |
|---|---|---|
| 1 | Ṁ35 | |
| 2 | Ṁ21 | |
| 3 | Ṁ11 | |
| 4 | Ṁ4 | |
| 5 | Ṁ2 |
People are also trading
Related questions
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
What will be the best performance on EnigmaEval by December 31st 2025?
Will any AI model score >80% on Epoch's Frontier Math Benchmark in 2025?
4% chance
Will an AI score over 80% on FrontierMath Benchmark in 2025
4% chance
In what year will AI achieve a score of 95% or higher on the SWE-bench Verified benchmark?
12/5/27
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2030?
77% chance
Top score on Humanity's Last Exam > 50% by 2027?
87% chance
Top score on Humanity's Last Exam > 50% by 2028?
95% chance
Top score on Humanity's Last Exam > 50% by 2029?
87% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2030?
34% chance