If humanity survives to 2100, what will experts believe was the correct level of AI risk for us to assess in 2023?
AIAI SafetyAI risk
Basic
15
Ṁ239
2100
38%
chance

In 2100, I will distribute a poll among philosophers, superforecasters, AI professionals, superintelligences, and whatever other entities could reasonably be called "experts" to determine what probability they believe was correct to assign to the following statement in 2023:

Before 2075, humanity will be extinct or have suffered a fate worse than extinction, due to the effects of smarter-than-human artificial intelligence.

("Humanity" includes any non-biological successors that biological humans voluntarily turned into.)

Get Ṁ600 play money

Related questions

7 Comments
15 Holders
21 Trades
Sort by:

Related' let's find out how to survive

https://manifold.markets/Jono3h/why-did-ai-not-kill-us-before-2100

If you are dead in 2100 how should this market resolve?

@MartinRandall Whoever is in charge of market resolution should perform the same experiment as closely to how I would have performed it as they can and resolve based on the results.

Regardless of the actual probability of the counterfactual, the hindsight bias will be enormous.

Especially since, if indeed AGI -> doom, then no doom -> no AGI, and polling taking place means no doom, so only lowly biased human will answer this poll.

@CamillePerrin I don't think it's widely accepted that it's impossible to have a non-genocidal AI. Also I think humans have estimated the risk of Cuban Missile Crisis etc al without enormous hindsight bias.

predicts YES

@CamillePerrin what does "lowly biased human" mean?

@jameso Humans are not very good reasoners, compared to the ideal.

https://en.wikipedia.org/wiki/List_of_cognitive_biases

Related questions