HumanEval 90% #3: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2026?
8
248
Ṁ367Ṁ190
2026
84%
chance
1D
1W
1M
ALL
Benchmark link: https://paperswithcode.com/sota/code-generation-on-humaneval
pass@1 means the model gets a single attempt.
Get Ṁ1,000 play money
Related questions
Will a large language model beat a super grandmaster playing chess by 2028?
34% chance
Will a brain-computer interface user vote and comment on this market by 2025?
42% chance
By EOY 2026, will it seem as if deep learning hit a wall by EOY 2025?
38% chance