Will an LLM get > 50% on hard problems on LiveCodeBench Pro?
5
1kṀ1460Jan 1
18%
chance
1H
6H
1D
1W
1M
ALL

This question is managed and resolved by Manifold.
Get
1,000 to start trading!
People are also trading
Related questions
Can LLM generate a Lonpos puzzle solution before the end of 2025?
18% chance
Will an LLM agent complete >50% of the lab tasks on the Factorio Learning Environment benchmark in 2025?
48% chance
EOY 2025: Will open LLMs perform at least as well as 50 Elo below closed-source LLMs on coding?
72% chance
LLM reaches >90% Brier score on Prophet Arena by 2026?
5% chance
Will an LLM report >50% score on ARC in 2025?
99% chance
LLM Hallucination: Will an LLM score >90% on SimpleQA before 2026?
15% chance
Will an LLM be able to solve Raven's Progressive Matrices from an image in 2025?
30% chance
Will LLMs be able to formally verify non-trivial programs by the end of 2025?
12% chance
Will an LLM consistently create 5x5 word squares by 2026?
94% chance
Will the best public LLM at the end of 2025 solve more than 5 of the first 10 Project Euler problems published in 2026?
66% chance