I Run the World’s Oldest AI Safety Lab... There’s a “High Double-Digit” Chance AI Kills Us

<p><strong>Malo Bourgon</strong> is the CEO of the Machine Intelligence Research Institute (MIRI), the world&#39;s oldest AI safety organization, and has testified before the US Senate and Canada&#39;s Parliament on the risks of smarter-than-human AI. In this conversation, he lays out why he believes the race to superintelligence carries a serious risk of human extinction, how today&#39;s AI is already showing early signs of deception and self-preservation, and what it would take to steer toward a future where things go right.</p><p>In this episode, we discuss:</p><p>(0:00) Trailer</p><p>(1:48) The Extinction Risk And How Much Time We Actually Have<br>(3:40) The Real Logic Behind AI Extinction (It&#39;s Not The Terminator)<br>(6:09) The Chimp Analogy: Why A Smarter AI Becomes Indifferent To Us<br>(8:20) Why AI Develops Self-Preservation And Resists Being Changed<br>(9:38) AI Systems Already Resisting Shutdown In Real Tests<br>(10:58) Why AI Is Learning To Tell When It&#39;s Being Tested<br>(12:53) Is Anything More Important Than AI Safety Right Now?<br>(14:14) What The World Could Look Like By 2050<br>(15:29) The End Of Jobs And The Coming Crisis Of Meaning<br>(28:19) The Evolution Analogy: Why AI Learns Goals We Never Gave It<br>(35:19) If AI Beats Us At Intelligence, What Makes Us Human?<br>(41:30) Neuralink And Merging With AI: Driver Or Passenger?<br>(51:13) Which Jobs And Careers Survive The Next 10 Years<br>(1:14:31) Why We Can&#39;t Just &quot;Pull The Plug&quot; (The Loyal General Problem)<br>(1:18:02) The Best-Case Scenario And Reasons For Hope</p><p><br></p><p>Learn more about Malo Bourgon here:</p><p>Website: <a href="https://intelligence.org">https://intelligence.org</a><br>LinkedIn: <a href="https://www.linkedin.com/in/malob">https://www.linkedin.com/in/malob</a><br>MIRI team page: <a href="https://intelligence.org/team/malo-bourgon">https://intelligence.org/team/malo-bourgon</a></p><p><br></p><p>Watch this episode on Youtube: https://youtu.be/3DuhFVHZFks</p><p><br></p><p>📸 Connect with us on IG: https://instagram.com/growthminds.podcastMade possible by:Jumpspeak: ⁠https://www.jumpspeak.com⁠Follow Sean KimInstagram: https://www.instagram.com/heyseankim/?hl=enX: https://x.com/heyseankim?lang=enLinkedIn: https://www.linkedin.com/in/heyseankim</p>