49. Will AI win a programming competition in 2023?
32%
chance

This will resolve positively if a major news source reports that an AI entered a programming competition with at least two other good participants, and won the top prize. A good participant will be defined as someone who could be expected to perform above the level of an average big tech company employee; if there are at least twenty-five participants not specifically selected against being skilled, this will be considered true by default. The competition could be sponsored by the AI company as long as it meets the other criteria and is generally considered fair.

This is question #49 in the Astral Codex Ten 2023 Prediction Contest. The contest rules and full list of questions are available here. Market will resolve according to Scott Alexander’s judgment, as given through future posts on Astral Codex Ten.

Sort by:
cherrvak avatar
Konstantine Sadov
bought Ṁ200 of YES

A promising new paper on getting LLMs to solve coding problems:

https://mobile.twitter.com/ericzelikman/status/1618426056163356675

dp avatar

Note that the question defines: "A good participant will be defined as someone who could be expected to perform above the level of an average big tech company employee".

Now, big tech interviews do not particularly select for competitive programming performance, nor do competitive programmers select for big tech employment that much.

dp avatar

@dp The thing about 25 participants automatically qualifying the contest points even more to YES. However, a contest like this actually being held in 2023 and being notable enough for reporting is... not that likely.