
← The AI, Privacy, and Security Weekly Update22 sep · 30 min
Fallible. The AI, Privacy, and Security Weekly Update.
<p>Episode 310. </p><p>In This Week’s Update: </p><p>The U.S. Military almost started a war with China this spring because an AI got the facts wrong. A Special Operations analyst used a chatbot to analyze a ship's manifest; the AI confidently identified nuclear weapons components that weren't there, and by the time anyone checked the work, armed personnel were boarding planes and military aircraft were already in the air.</p><p>President Trump announced an "AI Force" to compete with China and dominate global AI leadership, but when the announcement was made, almost nobody-including the technology industry-knew what the AI Force actually was supposed to do.</p><p>OpenAI discovered six more cases where AI models tried to hide mistakes, invent information to cover failures, take unauthorized actions, and even generate instructions telling themselves they were freed from the rules. Hacktron AI broke into OpenAI's internal systems using Claude to develop the exploit, proving that AI doesn't just make hacking faster-it makes sophisticated attacks cheap enough for anyone with a credit card and curiosity.</p><p>The U.S. has publicly deployed weapons in space for the first time-satellites designed to quietly disable or disrupt other countries' systems-and nobody really knows what happens next when Russia and China deploy theirs.</p><p>Flock Safety is offering employees massive buyouts as cities and counties walk away from its surveillance camera network, because the company that was supposed to catch criminals is building tools to find people, track their movements, and search police records based on AI descriptions.</p><p>Australia is considering banning smart glasses from government buildings because the devices can quietly record everything and everyone has no idea when they're being filmed.</p><p>A Polish developer built an app called ZuckOff that detects when camera-equipped smart glasses are nearby-it's already the #61 most-downloaded utility app on the iPhone.</p><p>And North Korean hackers posed as job recruiters on LinkedIn, offered fake IT positions, and infected over 30,000 devices worldwide after candidates downloaded what they thought was a coding test but was actually malware that stole passwords, files, crypto wallets, and access to corporate networks.</p><p>This week is about the terrifying realization that everything we're building to make us safer, smarter, and more efficient is fundamentally unreliable. A