Will GPT-5 perform better than o1 (not preview) at AIME 2024, Codeforces elo, GPQA, or the 2024 ioi?
10
100Ṁ326Dec 2
91%
chance
1D
1W
1M
ALL
o1's scores are the ones mentioned here. https://openai.com/index/learning-to-reason-with-llms/
Resolves yes if OpenAI or a third party tester is able to get GPT-5 to achieve higher scores on any of these benchmarks without any kind of prompt engineering or agent scaffolding
This question is managed and resolved by Manifold.
Get
1,000 to start trading!
1,000Sort by:
I had a previous question that asked whether I would judge GPT-5 smarter than 01 that is sitting at 85% yes.
Personally I am unsure why people think this since it is heavily implied GPT-5 won't utilize the scaled test-time compute paradigm which was so key to o1's success. I would bet that GPT-5 will be unable to do this and that the goal is more so achieving near o1 performance more quickly and economically
Related questions
Related questions
Will GPT-5 come out before 2027?
90% chance
Will an AI win a gold medal on the IOI (competitive programming contest) before 2027?
88% chance
Will an AI win a gold medal on the IOI (competitive programming contest) before 2026?
81% chance
Will an AI win a gold medal on the IOI (competitive programming contest) before 2030?
95% chance
Will GPT-5 reach a 1000 rating on Codeforces?
96% chance
Will GPT-5 win Bronze or better at IMO 2025?
22% chance
Will I judge GPT-5 to be smarter than o1 (not preview) after both are released?
81% chance
Will GPT-5 have an estimated IQ higher than 101?
79% chance
Will GPT-5 ace exams?
76% chance
Will GPT-5 be able to get gold on the International Mathematical Olympiad?
23% chance