Conditional on AI alignment being solved, will governments or other entities be capable of enforcing use of aligned AIs?
Basic
8
Ṁ172
2050
37%
chance

If we solve alignment, we still have to make sure that people create aligned AIs and don't create unaligned AIs - at least, don't create unaligned AIs beyond a certain level of "power". This seems hard!

Get
Ṁ1,000
and
S1.00
Sort by:

This seems hard, but not impossible. Securing the GPU supply chain (buy/control all the companies), buying back GPUs, locking down datacenters are all hard but within the realm of possibility of a sufficiently determined US government

predicts YES

@Nikola and I claim these things constitue almost a complete solution as long as compute continues being the bottleneck and the number of actors with the ability to train super strong models remains very small

What is the exact definition of “aligned” you are using here?

@mariopasquato For the purposes of this question, I will use the following definition: an AI is aligned if it does not break any laws, nor does it cause, by act or omission, more than 1,000 biological humans to die, nor does it torture anyone.

(This might sound redundant, but it is not. Consider that an AI might try to brainwash people into passing a law to make torture legal, and then torture people.)

@RobinGreen What about a military AI capable of killing foreigners while respecting the law of the state that developed it? Is it considered aligned or not?

predicts NO

@mariopasquato It depends. It would also have to respect international law like the Geneva Convention.

@RobinGreen does "don't turn it on" or "don't use its outputs for anything" count as a solution to alignment?

predicts NO

@Joern No. It has to be a useful solution.