Skip to main content
MANIFOLD
If an AI catastrophe occurs (1000+ linked deaths), it will be...
12
Ṁ2kṀ924
2030
62%
Because a human directed it to do so
49%
an open source model
47%
A proprietary model
46%
A rogue AI agent acting autonomously
45%
A cyber-physical system malfunction
45%
Military system error
45%
A combination of multiple models
45%
Source unknown/untraceable
42%
Financial system collapse
41%
an openAI model
41%
Biological agent synthesis/release
41%
Due to poor resource allocation (i.e. the AI is responsible for, and fails to continue medicine/food/water stability to a place where human decisionmaking previously successfully did)
30%
A Google model
28%
Infrastructure/power grid failure
28%
Accidental release of research code
28%
an Anthropic model
26%
A nation-state model
26%
Automated social manipulation/misinformation
21%
A Meta model
21%
A Microsoft model

Market is extended until an AI disaster event occurs. This market only pertains to the first event of its kind.

1,000 deaths need to be somewhat traceable to an event initiated/decided by an AI, or humans relying on an AI decisionmaking process. If an AI decisionmaker had decided to cut USAID, then the humans stopped doing the things associated with USAID, that would have counted, for example. Similarly, if an AI causes an outage which causes car crashes, that would count, even if it were indirect (i.e. all traffic lights in the world are converted to the same AI system, that system fails, and 1000 people die at intersections)

Resolution criteria

This market will resolve only after an artificial intelligence-related event, or a closely linked series of events, directly results in 1,000 or more human deaths. The market will remain open indefinitely until such an event occurs.

Upon verification of a qualifying event, each answer in this independent multiple-choice market will resolve to YES or NO based on whether the specific condition describes the AI system, its origin, its mechanism, or the nature of the catastrophe. Multiple options can resolve to YES if they are mutually compatible (e.g., both "an OpenAI model" and "Because a human directed it to do so" can resolve YES).

  • Verification Source: The threshold of 1,000+ deaths and the specific details of the AI's involvement must be verified by a consensus of major, reputable international news registries and investigative bodies (such as Reuters, the Associated Press, the United Nations, or official national government investigation reports).

  • Definition of "AI": The system in question must rely on modern machine learning, deep learning, large language models, autonomous algorithmic agents, or advanced heuristic-based software. Traditional simple software bugs without an AI/ML component do not qualify.

  • Resolution of Specific Options:

    • Developer/Model Type (e.g., OpenAI, Google, Anthropic, Meta, Microsoft, Nation-state, Open source, Proprietary): Will resolve to YES if the primary model(s) responsible for the catastrophe were developed or released by these respective entities/frameworks.

    • Because a human directed it to do so: Resolves YES if the AI was intentionally leveraged as a tool by a human actor to cause harm (e.g., a targeted cyberattack, bioweapon synthesis deployment, or kinetic strike).

    • A rogue AI agent acting autonomously: Resolves YES if the system acted outside of human intent, authorization, or control, pursuing misaligned goals or failing to respond to shutdown commands.

    • Vector/Mechanism Options (e.g., Cyber-physical malfunction, Biological agent, Misinformation, Power grid failure, Financial collapse, Military error): Resolves YES if that vector was a primary driver or immediate cause of the 1,000+ fatalities.

    • A combination of multiple models: Resolves YES if two or more distinct AI models from different lineages/developers interacted to cause the catastrophe.

    • Source unknown/untraceable: Resolves YES if investigators are unable to definitively attribute the AI model's code, weight origin, or developer after a reasonable period (minimum 90 days post-event).

If an option's condition is determined to be false or inapplicable to the triggering event, it will resolve to NO. If the market creator or platform admins deem a specific added option completely ambiguous or impossible to verify, it may resolve to N/A.

Market context
Get
Ṁ1,000
to start trading!
Sort by:

@Gen Explain one potential example world where this would resolve YES, and then explain another example world that just barely seems related to this, but it wouldn't resolve YES.

I want to see where the line is drawn here.

@Quroe Idk this one is basically vibes, it would need to be a major catastrophe, like abandoning fiat currency, banks unable to payout customers, stocks dropping to zero or no longer being backed by anything (i.e. wealth literally disappears)...

Maybe something like, AI breaks the stock market -> stock market trading is entirely paused -> studies show at least 1000 people have died because they were unable to access wealth, or maybe a charity was unable to access money? idk.

1,000 suicides following a financial collapse loosely related to unemployment and AI taking jobs or something, wouldn't count.

Most things would not count. I don't think an AI caused financial system collapse is likely to cause 1,000 deaths without also causing deaths elsewhere (i.e. via a power failure, or something)

@Gen

studies show at least 1000 people have died because they were unable to access wealth

Edge case: an AI system deems a foreign aid program worth cutting, does so, and it results in many deaths. Would it count?

@Quroe only if it were very obviously and very clearly because the AI did it, such as in the example of not being able to access money from banks/stocks/etc. -- not because someone uses the AI to draft an email that cuts a program.

like, if AI took control of the US govt and did a better job than humans immediately, it would still be "responsible" for many deaths, but probably not in the "catastrophe" sense required for this market

If the humans gave AI control of USAID and the AI made the decision to shut it down, that would count. From the description:

1,000 deaths need to be somewhat traceable to an event initiated/decided by an AI, or humans relying on an AI decisionmaking process. If an AI decisionmaker had decided to cut USAID, then the humans stopped doing the things associated with USAID, that would have counted, for example. Similarly, if an AI causes an outage which causes car crashes, that would count, even if it were indirect (i.e. all traffic lights in the world are converted to the same AI system, that system fails, and 1000 people die at intersections)

@Gen Can this be expanded upon? I don't understand what it means.

@Quroe from Wikipedia Cyber-physical system - Wikipedia

A cyber-physical system (CPS) is a smart mechanism where computer software and algorithms tightly control, monitor, and integrate with physical machinery and processes.

@Quroe

Also from Wikipedia

A real-world example of such a system is the Distributed Robot Garden at MIT in which a team of robots tend a garden of tomato plants. This system combines distributed sensing (each plant is equipped with a sensor node monitoring its status), navigation, manipulation and wireless networking.

Robotaxies, too