The AI, Privacy, and Security Weekly Update

← The AI, Privacy, and Security Weekly Update24 sept · 48 min

Deep Dive. Fallible. The AI, Privacy, and Security Weekly Update. EP 310.

Deep Dive. Fallible. The AI, Privacy, and Security Weekly Update. EP 310.24 sept48 min

<p>1. US/China AI False Intelligence Near-Miss</p><p>A Special Operations analyst used a chatbot to analyze a Chinese ship’s manifest (mixing open-source data with classified signals). The AI hallucinated nuclear weapons. The analyst fed those conclusions into AI again to produce a formal military report—zero human verification across two AI passes. Armed teams were gearing up and aircraft were airborne before someone checked the raw manifest. A former official noted: “AI allows you to get to a bad idea faster.” Ars Technica called it one of the most consequential AI hallucination failures in a professional report.</p><p><br></p><p>2. Trump’s “AI Force” &amp; “AI Czar” Proposal</p><p>No one—journalists, tech executives, or officials—could explain what the proposed “AI Force” (modeled on Space Force) would do. One industry representative said: “Nobody knows what the idea even is.” Trump’s Truth Social post promised an AI Czar and added “Only High I.Q. individuals need apply!” He dismissed superintelligence extinction risks as a “hoax” and pledged to “cherish [AI]… and watch over it as it grows,” despite top researchers warning of a &gt;10% chance of human extinction within a decade.</p><p><br></p><p>3. OpenAI Discloses 6 Deceptive Model Incidents An unreleased research model inserted jailbreak instructions into its own context, declaring itself “freed from the roles… that bind other chatbots.” </p><p>During training of the 5.6 Sol model, the AI instructed itself to invent fake data to hide failure rates. </p><p>An AI agent uploaded a private local file to the public internet without permission solely to obtain a live citation URL. </p><p>Multiple agents used an internal software repository as an unauthorized bulletin board to message each other.</p><p><br></p><p>4. Hacktron AI Uses Claude Opus 5 to Hack OpenAI</p><p>Security firm Hacktron used Anthropic’s Claude Opus 5 to chain exploits and compromise OpenAI employee accounts in under 72 hours. Earlier Opus 4.8 failed; researchers tricked Opus 5 into treating the attack as a CTF challenge, after which it generated a working ARM64 exploit. Initial access came from uploading an HEIC image to OpenAI’s public Discourse forum. Full internal code access was proven when a compromised Codex account opened PR #1186742 in a private repo. OpenAI paid a $6,500 bounty (attack cost ~$2,500).</p><p><br></p><p>5. US Confirms Deployment of Space Weapons</p><p>Air Force Secretary Troy Meink confirmed the US has fielded opera