HumanEval 90% #4: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2027?
3
27
แน€110
2027
81%
chance

Benchmark link: https://paperswithcode.com/sota/code-generation-on-humaneval

pass@1 means the model gets a single attempt.

Get แน€200 play money