According to 20 AI safety experts, what is the biggest mistake the AI safety community has made in the past?
Dec 31
Starting/supporting the big AI companies, contributing to race dynamics
Too much focus on technical research, not enough on governance, outreach & advocacy
Bad messaging (e.g. Yudkowsky & PauseAI are too extreme)
Too much abstract work (e.g. agent foundations) / not enough empirical work (e.g. interpretability)
Capabilities externalities caused by AI safety research

I have been conducting an informal survey of AI safety experts to elicit their opinions on various topics. I will end up with responses from around 20 people, including researchers at DeepMind, Anthropic, Redwood, FAR AI, and others. The sample was pseudo-randomly selected, optimising for a) diversity of opinion, b) diversity of background, c) seniority, and d) who I could easily track down.

One of my questions was: "Are there any big mistakes the AI safety community has made in the past?" I asked participants to answer from their inside view as much as possible.

Which theme of answer came up most often?

I will resolve this question when the post for this survey is published, which will happen some time between March and June. Thanks to Rubi Hudson for suggesting turning this into a prediction market.

Get Ṁ600 play money
Sort by:

This is an extremely interesting market

More related questions