HumanEval 90% #5: Will pass@1 performance on the HumanEval benchmark be >= 90% by 2028?
3
27
110
2028
87%
chance

Benchmark link: https://paperswithcode.com/sota/code-generation-on-humaneval

pass@1 means the model gets a single attempt.

Get Ṁ200 play money