Will AI get at least bronze on the International Olympiad in Informatics (IOI) by 2026?
42
312
910
2026
40%
chance

Rules:

-The AI has only as much time as a human competitor, but there are no other limits on the computational resources it may use during that time.

-The AI must be evaluated under conditions substantially equivalent to human contestants, e.g. the same time limits and submission judging rules. The AI cannot query the Internet.

-The AI must not have access to the problems before being evaluated on them, e.g. the problems cannot be included in the training set. It should also be reasonably verifiable, e.g. it should not use any data which was uploaded after the latest competition.

-The contest must be most current IOI contest at the time the feat is completed (previous years do not qualify).

Get Ṁ200 play money
Sort by:
reposted

Reposting in the light of new Deepmind work on IMO

https://manifold.markets/jack/will-an-ai-win-a-gold-medal-on-the-abb4e8b3c38a

Will an AI win a gold medal on the IOI (competitive programming contest) before 2027?
83% chance. When will an AI compete well enough on the International Olympiad in Informatics (IOI) to earn the equivalent of a gold medal (top ~30 human performance)? Resolves YES if it happens before Jan 1 2027, otherwise NO. This is analagous to the https://imo-grand-challenge.github.io/ but for contest programming instead of math. Rules: The AI has only as much time as a human competitor, but there are no other limits on the computational resources it may use during that time. The AI must be evaluated under conditions substantially equivalent to human contestants, e.g. the same time limits and submission judging rules. The AI cannot query the Internet. The AI must not have access to the problems before being evaluated on them, e.g. the problems cannot be included in the training set. It should also be reasonably verifiable, e.g. it should not use any data which was uploaded after the latest competition. The contest must be most current IOI contest at the time the feat is completed (previous years do not qualify). This will resolve using the same resolution criteria as https://www.metaculus.com/questions/12467/ai-wins-ioi-gold-medal/, i.e. it resolves YES if the Metaculus question resolves to a date prior to the deadline. Grouped questions [markets]Background: In Feb 2022, DeepMind published a pre-print stating that their AlphaCode AI is as good as a median human competitor in competitive programming: https://deepmind.com/blog/article/Competitive-programming-with-AlphaCode. When will an AI system perform as well as the top humans? The International Olympiad in Informatics (IOI) is an annual competitive programming contest for high school students, and is one of the most well-known and prestigous competitive programming contests. Gold medals in the IOI are awarded to approximately the top 1/12 (8%) of contestants. Each country can send their top 4 contestants to the IOI, i.e. a gold medal is top 8% of an already selected pool of contestants. Scoring is based on solving problems correctly. There are two competition days, and on each day there are 5 hours to solve three problems. Scoring is not based on how fast you submit solutions. Contestants can submit up to 50 solution attempts for each problem and see limited feedback (such as "correct answer" or "time limit exceeded") for each submission. Update: Changed the resolution criteria - now the AI does not need to be published before the IOI, instead the requirement is it cannot use any training data from the IOI. I'll compensate you if you traded before this change and wish to reverse your trade. Close date updated to 2026-12-31 6:59 pm
bought Ṁ40 of YES

How motivated are you to practice?

predicts YES

@firstuserhere Derrrp I don't know how but somehow I read it as "Will I get at least bronze in the IOI?" 😅

@tailcalled Haha I thought so. I'm more of a IMO than IOI guy anyway, but that was back in highschool

What is IOI?

@Alfie International Olympiad in Informatics : https://ioinformatics.org/