HumanEval 90% #3: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2026?
8
248
190
2026
84%
chance

Benchmark link: https://paperswithcode.com/sota/code-generation-on-humaneval

pass@1 means the model gets a single attempt.

Get Ṁ1,000 play money
Sort by:
bought Ṁ30 of YES