Robert Wright: AI Alignment Is a Moral Problem, Not a Technical One

The real AI alignment problem is not technical. It is moral. You cannot align a superintelligence to human values if humans cannot agree on what those values are, and you cannot get that agreement without a level of global cooperation we have never managed before. Subscribe if you want science with evidence, not speculation.

The Tower of Babel is the AI parable nobody is reading. Technology that outpaces wisdom fragments the people building it. The Fermi paradox offers the grimmer version: civilizations that reach the capacity to blow themselves up typically do. Robert Wright has been watching this longer than almost anyone, he was reporting on neural networks in 1983, and his conclusion is not that the machines will fail the test. It is that we will.

Wright’s book argues that superintelligence is not the danger and AI alignment is not the solution unless it comes with a moral advance. Passing the God test requires something no lab can ship.

What you’ll hear:

-Why Wright thinks p(doom) fails as a scientific concept

-What the binding of Isaac and the Tower of Babel have in common as moral tests

-Why global cooperation is the only thing that can actually slow AI down

-What Lee Smolin’s cosmological natural selection has to do with the Fermi paradox

-What Wright thinks Eastern and Western enlightenment have in common and why it matters now

-Whether there is a role for humanity inside the global brain or only for the machines

“We face the kind of test that God would give.” — Robert Wright

CHAPTERS