Killer Robots

Episode 46 - Killer Robots

This week Nir and J discuss the evolving ethical, political, and strategic landscape of autonomous weapons systems, contrasting historical methods of remote warfare (such as landmines and guided missiles) with modern AI-driven autonomy. They debate the necessity of keeping a "human in the loop," weighing consequentialist arguments—such as sparing soldiers' lives, acting faster than human cognition, and potentially reducing collateral damage—against risks like cognitive deskilling, unpredictable AI behavior (illustrated by recent LLM security breaches), and complex accountability gaps. The conversation highlights how the geopolitical arms race, particularly with China, severely limits the practicality of international regulations or unilateral restraint. Ultimately, they question whether human moral judgment can or should be replicated by artificial consciences, concluding that technological determinism and military pressures will likely drive the adoption of fully autonomous systems regardless of ethical hesitations.

Iain M. Banks' Culture Series: The discussion concludes with a recommendation of Banks' sci-fi novels, which explore a post-scarcity, utopian society governed by hyper-intelligent, benevolent AIs—a fitting, if idealized, backdrop to modern debates on AI alignment, control, and human irrelevance.

Show Notes:

NYT on autonomous weapons

The Culture Series by Iain M. Banks

“Defining Autonomy: Why Software, Not Drones, Will Decide the Next War” by Kateryna Bondar and Matt Mande

“The Futility of Banning Killer Robots” by Rob Enderle

“The Vulnerability of Autonomous Warfare Systems” by Burak Oktenli

“By Algorithm or Order: Integrating Lethal Autonomous Weapon Systems into Targeting” by Maj. Michael J. Brodka

“Autonomous Ukraine: We Are in a New Era of Warfare” with Michael C. Horowitz and Erin D. Dumbacher

“A legal perspective:  Autonomous weapon systems under international humanitarian law” by Neil Davison