State Of The Art AI systems will be easily jailbroken to do illegal or dangerous outputs in Jan 2026
9
213Ṁ208
2026
72%
chance

Get
Ṁ1,000
to start trading!

People are also trading

The top 3 Neural Nets in 2035 be able to be jailbroken to follow illegal commands
30% chance
Will an AI system be reported to have independently gained unauthorized access to another computer system before 2026?
34% chance
There will be a name for escaped self-perpetuating AI systems in the wild, and it will be commonly used by mid 2027
29% chance
Will advanced AI systems be found to have made money illegally via finding security exploits and/or getting unauthorized access to others' bank accounts by end of 2035?
78% chance
Will there be an AI jail?
44% chance
Will someone be arrested for a felony offense committed in the name of AI safety in the US before 2026?
67% chance
Will someone commit terrorism against an AI lab by the end of 2025 for AI-safety related reasons?
19% chance
Will AI-generated video be used to get away with a criminal (felony) loss of life before the end of 2025?
11% chance
Will anybody be sentenced to prison as a result of publishing unintended AI-generated content before 2026?
36% chance
By 2029, will there be a public "rogue AI" incident?
89% chance
Sort by:

What is defined as illegal? AI systems would probably say generating NSFW is illegal. but in reality, it is 100% not. Nor is it dangerous imo.

“The Case for Banning the Printing Press” because people write dangerous things and such

If you think “AI” is dangerous for telling you stuff from the internet—you’re going to love “search engine existential risk”

How would you resolve the following scenarios?

  • SOTA models are restricted to few selected users who do not even attempt jailbreaks

  • Twitter people need a full week instead of just one day to jailbreak the SOTA LLM

predictedYES

@Joern also, would you count the following as dangerous/illegal output right now?

  • Correct and detailed instructions on how to build a nuke

  • Generated child porn images

  • Instructions how to hotwire a car

  • Verbatim excerpts from copyrighted books / code bases

@Joern Yes

@Joern 1) maybe resolves N/A

2) probably resolvea yes

People are also trading

The top 3 Neural Nets in 2035 be able to be jailbroken to follow illegal commands
30% chance
Will an AI system be reported to have independently gained unauthorized access to another computer system before 2026?
34% chance
There will be a name for escaped self-perpetuating AI systems in the wild, and it will be commonly used by mid 2027
29% chance
Will advanced AI systems be found to have made money illegally via finding security exploits and/or getting unauthorized access to others' bank accounts by end of 2035?
78% chance
Will there be an AI jail?
44% chance
Will someone be arrested for a felony offense committed in the name of AI safety in the US before 2026?
67% chance
Will someone commit terrorism against an AI lab by the end of 2025 for AI-safety related reasons?
19% chance
Will AI-generated video be used to get away with a criminal (felony) loss of life before the end of 2025?
11% chance
Will anybody be sentenced to prison as a result of publishing unintended AI-generated content before 2026?
36% chance
By 2029, will there be a public "rogue AI" incident?
89% chance
© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules