IE "make me a 120 minute Star Trek / Star Wars crossover". It should be more or less comparable to a big-budget studio film, although it doesn't have to pass a full Turing Test as long as it's pretty good. The AI doesn't have to be available to the public, as long as it's confirmed to exist.

Scott Alexander's 5 year predictions

Technology

AI Media Creation

https://www.lesswrong.com/posts/sWLLdG6DWJEy3CH7n/imo-challenge-bet-with-eliezer

 Eliezer has this at >16%; Paul at <8%. Resolves to YES if either Eliezer or Paul acknowledge that an AI has succeeded at this task.

https://manifold.markets/MatthewBarnett/will-a-machine-learning-model-score-f0d93ee0119b

Update: As noted by Paul, the qualifying years for IMO completion are 2023, 2024, and 2025.

Technical AI Timelines

IMO Grand Challenge

Mathematics

Third Party Validated, Predictive Markets: AI

I will resolve this based on some combination of how much it gets talked about in elections, how much money goes to interest groups on both topics, and how much of the "political conversation" seems to be about either.

Politics

US Politics

Medicine 

Abortion

Resolves YES if GPT-5 is publicly released before Jan 1, 2025; resolves NO otherwise.

Update from March 18: If the next OpenAI flagship model deviates from the GPT-N naming scheme 

 that is going to be released from OpenAI (e.g. they completely changed the trajectory of their naming scheme) then I will count it as "GPT-5" regardless.

However, if the next flagship model is not called GPT-5 but still conforms to the OpenAI GPT-N naming scheme (e.g. GPT-4.5) 

there will eventually be a model called GPT-5

 that will be released (i.e. they are going to continue with the same naming scheme) then I will not count it as "GPT-5".

🤖 AI

🖥️ Technology

🤖 OpenAI

GPT-5 Speculation

ChatGPT

This question resolves to YES if during at least one of the main (non-VP) 2024 general presidential election debates in the United States, the moderator asks at least two separate questions directly related to artificial intelligence, such as the potential for job losses due to AI automation, or existential risk from AI. This question also resolves to YES if AI is otherwise brought up by a candidate in the context of a question unrelated to AI and ALL candidates talk about AI at least once during the same debate, with at least one of the candidates saying "AI", "artificial intelligence", "robots" or a close synonym at least three separate times, at least five seconds apart, during the same debate. Otherwise, this question resolves to NO.

Asking "at least two separate questions" means that the moderator must pose two semantically distinct and individual queries, each intended to elicit a unique response, specifically about artificial intelligence. In other words, simply repeating the same question doesn't count as two separate questions, even if the question is asked twice, first to one candidate, and then a second time to the other candidate. Moreover, asking two distinct questions without waiting for the answer to the first one counts as two separate questions for the purpose of this question. For example, a clear positive instance would be asking first, "How do you plan to manage the existential risks from AI?" and then later asking, "What are your proposals to mitigate job loss due to automation from AI?" These are two separate questions because they cover different facets of artificial intelligence—existential risk and employment. A clear negative example would be if the moderator simply asked, "How do you plan to manage the existential risks from AI?" to one candidate, and then later said "Same question to you" to the other candidate. Even though the question is asked twice, it's not considered two "separate" questions because it's a repetition of the same query.

When it comes to questions related to automation and job losses, the key factor that determines whether the question is "directly related to artificial intelligence" is whether the moderator mentions AI technologies or AI companies, such as ChatGPT, OpenAI, generative AI, or neural networks; any question will automatically qualify if the moderator says the word "AI" or "artificial intelligence" in the question. General questions about automation or job losses that don't clearly link back to AI won't be considered "directly related to artificial intelligence". For example, the following questions would NOT count as being directly related to artificial intelligence:

If there are no 2024 general presidential election debates, this question resolves to N/A.

🗳️ Politics

presidential debate

If a large language models beats a super grandmaster (Classic elo of above 2,700) while playing blind chess by 2028, this market resolves to YES.

I will ignore fun games, at my discretion. (Say a game where Hiraku loses to ChatGPT because he played the Bongcloud)

Some clarification (28th Mar 2023): This market grew fast with a unclear description. My idea is to check whether a general intelligence can play chess, without being created specifically for doing so (like humans aren't chess playing machines). Some previous comments I did.

1- To decide whether a given program is a LLM, I'll rely in the media and the nomenclature the creators give to it. If they choose to call it a LLM or some term that is related, I'll consider. Alternatively, a model that markets itself as a chess engine (or is called as such by the mainstream media) is unlikely to be qualified as a large language model.

2- The model can write as much as it want to reason about the best move. But it can't have external help beyond what is already in the weights of the model. For example, it can't access a chess engine or a chess game database. 

I won't bet on this market and I will refund anyone who feels betrayed by this new description and had open bets by 28th Mar 2023. This market will require judgement.

♟️ Chess

OpenAI's original definition for AGI is as follows:

Here is a diagram illustrating the governance structure of OpenAI:

The following is a quote from the original post by OpenAI, 

An action that would "hint at" OpenAI achieving AGI would be the exclusion of a specific state of the art AI system from IP licenses and other commercial terms with Microsoft while their partnership with Microsoft remains more or less the same structurally (although the composition might change). 

Same market for a longer time-frame is below:

AI Impacts

OpenAI

New York Mets beat Milwaukee Brewers - Mar 29

'29':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Baltimore Orioles beat Los Angeles Angels - Mar 28

'28':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 29

'29':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Chicago White Sox beat Detroit Tigers - Mar 28

'28':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Cincinnati Reds beat Washington Nationals - Mar 28

'28':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Houston Astros beat New York Yankees - Mar 28

'28':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Kansas City Royals beat Minnesota Twins - Mar 28

'28':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 28

'28':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Miami Marlins beat Pittsburgh Pirates - Mar 28

'28':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

San Diego Padres beat San Francisco Giants - Mar 28

'28':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Tampa Bay Rays beat Toronto Blue Jays - Mar 28

'28':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

'28':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Oakland Athletics beat Cleveland Guardians - Mar 28

'28':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Arizona Diamondbacks beat Colorado Rockies - Mar 28

'28':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

Seattle Mariners beat Boston Red Sox - Mar 28

'28':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Tampa Bay Rays beat Toronto Blue Jays - Mar 29

'29':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

Miami Marlins beat Pittsburgh Pirates - Mar 29

'29':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

Houston Astros beat New York Yankees - Mar 29

'29':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Arizona Diamondbacks beat Colorado Rockies - Mar 29

'29':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

Oakland Athletics beat Cleveland Guardians - Mar 29

'29':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

San Diego Padres beat San Francisco Giants - Mar 29

'29':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Seattle Mariners beat Boston Red Sox - Mar 29

'29':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 29

'29':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

New York Mets beat Milwaukee Brewers - Mar 30

'30':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Chicago White Sox beat Detroit Tigers - Mar 30

'30':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Baltimore Orioles beat Los Angeles Angels - Mar 30

'30':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 30

'30':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Oakland Athletics beat Cleveland Guardians - Mar 30

'30':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Cincinnati Reds beat Washington Nationals - Mar 30

'30':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Kansas City Royals beat Minnesota Twins - Mar 30

'30':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

Miami Marlins beat Pittsburgh Pirates - Mar 30

'30':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

Tampa Bay Rays beat Toronto Blue Jays - Mar 30

'30':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

'30':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Houston Astros beat New York Yankees - Mar 30

'30':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

San Diego Padres beat San Francisco Giants - Mar 30

'30':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Arizona Diamondbacks beatColorado Rockies - Mar 30

'30':6 'arizona':1 'beatcolorado':3 'diamondback':2 'mar':5 'rocki':4

Los Angeles Dodgers beat St. Louis Cardinals - Mar 30

'30':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Seattle Mariners beat Boston Red Sox - Mar 30

'30':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Baltimore Orioles beat Los Angeles Angels - Mar 31

'31':8 'angel':5,6 'baltimor':1 'beat':3 'los':4 'mar':7 'oriol':2

Philadelphia Phillies beat Atlanta Braves - Mar 31

'31':7 'atlanta':4 'beat':3 'brave':5 'mar':6 'philadelphia':1 'philli':2

Cincinnati Reds beat Washington Nationals - Mar 31

'31':7 'beat':3 'cincinnati':1 'mar':6 'nation':5 'red':2 'washington':4

Miami Marlins beat Pittsburgh Pirates - Mar 31

'31':7 'beat':3 'mar':6 'marlin':2 'miami':1 'pirat':5 'pittsburgh':4

New York Mets beat Milwaukee Brewers - Mar 31

'31':8 'beat':4 'brewer':6 'mar':7 'met':3 'milwauke':5 'new':1 'york':2

Tampa Bay Rays beat Toronto Blue Jays - Mar 31

'31':9 'bay':2 'beat':4 'blue':6 'jay':7 'mar':8 'ray':3 'tampa':1 'toronto':5

Chicago White Sox beat Detroit Tigers - Mar 31

'31':8 'beat':4 'chicago':1 'detroit':5 'mar':7 'sox':3 'tiger':6 'white':2

Houston Astros beat  New York Yankees - Mar 31

'31':8 'astro':2 'beat':3 'houston':1 'mar':7 'new':4 'yanke':6 'york':5

Kansas City Royals beat Minnesota Twins - Mar 31

'31':8 'beat':4 'citi':2 'kansa':1 'mar':7 'minnesota':5 'royal':3 'twin':6

'31':7 'beat':3 'chicago':4 'cub':5 'mar':6 'ranger':2 'texa':1

Oakland Athletics beat Cleveland Guardians - Mar 31

'31':7 'athlet':2 'beat':3 'cleveland':4 'guardian':5 'mar':6 'oakland':1

Arizona Diamondbacks beat Colorado Rockies - Mar 31

'31':7 'arizona':1 'beat':3 'colorado':4 'diamondback':2 'mar':6 'rocki':5

San Diego Padres beat San Francisco Giants - Mar 31

'31':9 'beat':4 'diego':2 'francisco':6 'giant':7 'mar':8 'padr':3 'san':1,5

Seattle Mariners beat Boston Red Sox - Mar 31

'31':8 'beat':3 'boston':4 'mar':7 'marin':2 'red':5 'seattl':1 'sox':6

Los Angeles Dodgers beat St. Louis Cardinals - Mar 31

'31':9 'angel':2 'beat':4 'cardin':7 'dodger':3 'los':1 'loui':6 'mar':8 'st':5

Chicago White Sox beat Atlanta Braves - Apr 1

'1':8 'apr':7 'atlanta':5 'beat':4 'brave':6 'chicago':1 'sox':3 'white':2

Chicago Cubs beat Colorado Rockies - Apr 1

'1':7 'apr':6 'beat':3 'chicago':1 'colorado':4 'cub':2 'rocki':5

Washington Nationals beat Pittsburgh Pirates - Apr 1

'1':7 'apr':6 'beat':3 'nation':2 'pirat':5 'pittsburgh':4 'washington':1

Baltimore Orioles beat Kansas City Royals - Apr 1

'1':8 'apr':7 'baltimor':1 'beat':3 'citi':5 'kansa':4 'oriol':2 'royal':6

Miami Marlins beat Los Angeles Angels - Apr 1

'1':8 'angel':5,6 'apr':7 'beat':3 'los':4 'marlin':2 'miami':1

Philadelphia Phillies beat Cincinnati Reds - Apr 1

'1':7 'apr':6 'beat':3 'cincinnati':4 'philadelphia':1 'philli':2 'red':5

Tampa Bay Rays beat Texas Rangers - Apr 1

'1':8 'apr':7 'bay':2 'beat':4 'ranger':6 'ray':3 'tampa':1 'texa':5

New York Mets beat Detroit Tigers - Apr 1

'1':8 'apr':7 'beat':4 'detroit':5 'met':3 'new':1 'tiger':6 'york':2

Houston Astros beat Toronto Blue Jays - Apr 1

'1':8 'apr':7 'astro':2 'beat':3 'blue':5 'houston':1 'jay':6 'toronto':4

Arizona Diamondbacks beat New York Yankees - Apr 1

'1':8 'apr':7 'arizona':1 'beat':3 'diamondback':2 'new':4 'yanke':6 'york':5

Oakland Athletics beat Boston Red Sox - Apr 1

'1':8 'apr':7 'athlet':2 'beat':3 'boston':4 'oakland':1 'red':5 'sox':6

San Diego Padres beat St. Louis Cardinals - Apr 1

'1':9 'apr':8 'beat':4 'cardin':7 'diego':2 'loui':6 'padr':3 'san':1 'st':5

Seattle Mariners beat Cleveland Guardians - Apr 1

'1':7 'apr':6 'beat':3 'cleveland':4 'guardian':5 'marin':2 'seattl':1

Los Angeles Dodgers beat San Francisco Giants - Apr 1

'1':9 'angel':2 'apr':8 'beat':4 'dodger':3 'francisco':6 'giant':7 'los':1 'san':5

Milwaukee Brewers beat Minnesota Twins - Apr 2

'2':7 'apr':6 'beat':3 'brewer':2 'milwauke':1 'minnesota':4 'twin':5

Baltimore Orioles beat Kansas City Royals - Apr 2

'2':8 'apr':7 'baltimor':1 'beat':3 'citi':5 'kansa':4 'oriol':2 'royal':6

Miami Marlins beat Los Angeles Angels - Apr 2

'2':8 'angel':5,6 'apr':7 'beat':3 'los':4 'marlin':2 'miami':1

Philadelphia Phillies beat Cincinnati Reds - Apr 2

'2':7 'apr':6 'beat':3 'cincinnati':4 'philadelphia':1 'philli':2 'red':5

Tampa Bay Rays beat Texas Rangers - Apr 2

'2':8 'apr':7 'bay':2 'beat':4 'ranger':6 'ray':3 'tampa':1 'texa':5

New York Mets beat Detroit Tigers - Apr 2

'2':8 'apr':7 'beat':4 'detroit':5 'met':3 'new':1 'tiger':6 'york':2

Chicago Cubs beat Colorado Rockies - Apr 2

'2':7 'apr':6 'beat':3 'chicago':1 'colorado':4 'cub':2 'rocki':5

Chicago White Sox beat Atlanta Braves - Apr 2

'2':8 'apr':7 'atlanta':5 'beat':4 'brave':6 'chicago':1 'sox':3 'white':2

Houston Astros beat Toronto Blue Jays - Apr 2

'2':8 'apr':7 'astro':2 'beat':3 'blue':5 'houston':1 'jay':6 'toronto':4

Arizona Diamondbacks beat New York Yankees - Apr 2

'2':8 'apr':7 'arizona':1 'beat':3 'diamondback':2 'new':4 'yanke':6 'york':5

Oakland Athletics beat Boston Red Sox - Apr 2

'2':8 'apr':7 'athlet':2 'beat':3 'boston':4 'oakland':1 'red':5 'sox':6