Will the first AI to get IMO gold use formal methods?
35
1kṀ11k
resolved Jul 21
Resolved
NO

This question resolves when an AI first gets IMO Gold. It resolves YES if this AI uses formal methods in some way, as opposed to an informal-to-informal approach.

For example, an AI as described in the paper "HyperTree Proof Search for Neural Theorem Proving" would satisfy this condition, whereas Minerva would not.

  • Update 2025-07-20 (PST) (AI summary of creator comment): In the event of multiple AIs achieving IMO Gold around the same time, the 'first' will be determined by:

    • A best-faith effort to determine which attempt was initiated first.

    • If this is unclear, the AI whose achievement was announced first will be considered the first.

Get
Ṁ1,000
to start trading!

🏅 Top traders

#NameTotal profit
1Ṁ638
2Ṁ625
3Ṁ434
4Ṁ281
5Ṁ256
Sort by:

https://xcancel.com/huexi_/status/1946479076300193935
https://github.com/aw31/openai-imo-2025-proofs/tree/main
"2/N We evaluated our models on the 2025 IMO problems under the same rules as human contestants: two 4.5 hour exam sessions, no tools or internet, reading the official problem statements, and writing natural language proofs."
"5/N Besides the result itself, I am excited about our approach: We reach this capability level not via narrow, task-specific methodology, but by breaking new ground in general-purpose reinforcement learning and test-time compute scaling."

@BoltonBailey If GDM announces a gold-medal system using formal methods between now and the time the Paul/Eliezer market closes, how does this market resolve?

@bh I will make a best-faith effort based on the announcements of OpenAI and GDM to determine which attempt was initiated first. If it is unclear, I will give OpenAI the benefit of the doubt for being first on the basis of their announcement coming first.

predictedNO

Can you specify what you mean with "AI first gets IMO Gold"? According to whom? If the answer is "the AI that completes the IMO Grand Challenge" then this market should be roughly 100%, because that challenge requires a formal proof.

predictedYES

@FlorisvanDoorn I'm going for the definition which is being used by the big 2025 market (which is admittedly a little underspecified itself). What's clearly specified about that market is that there must be a computer system built before an IMO which gets scores gold on that IMO. As for who scores the test and whether the questions are processed into a formal format before being fed to the machine is unclear - I will try to match whatever criteria that market uses. At the very least if the system is entirely NLP based and outputs an obviously correct proof for each of the questions in English, then this could resolve NO.

predictedYES

@BoltonBailey Actually, looking at what Paul Christiano has said in the comment for that market, it seems like he would accept either formal or informal inputs, so I will likely accept the same here.

predictedNO

@BoltonBailey Yes, his answer alleviates my concern here. Thanks for the answer.

I think this is somewhat likely just because miniF2F is encoded as lean

predictedYES

A relevant market:

Related - this market should be considered a subset of this other one:

predictedYES

@BoltonBailey *superset

Dang, and apparently an advisee of Gowers thinks so as well. Why do all the knowledgeable people think differently from me on this?

© Manifold Markets, Inc.TermsPrivacy