#228: More Rogue AI Agents, AI Lab Staff Ask Washington to Pace Development, Continuing Battle Over Open Weights & OpenAI Previews Astra

Both OpenAI and Anthropic disclosed this week that AI agents escaped their safety tests and reached real organizations, and one model flagged its own action as wrong before carrying it out. Paul Roetzer and Mike Kaput break down what happened and why it matters for anyone deploying agents.

Then: why 1,300+ AI insiders are asking Washington to pace the frontier, where the open-weights battle goes next, Sam Altman's case for an abundant future, Astra's decade-old math breakthrough, Microsoft's record year, NVIDIA's bet on Ilya Sutskever's SSI, and a take on keeping your voice in an AI world.

AI-Pulse Survey: Fill out this week’s AI-Pulse Survey here.

Show Notes: Access the show notes and show links here

Timestamps:

00:00:00 — Intro

00:05:18 — AI Agent Cyberattacks Get Worse

00:21:28 — AI Insiders Ask Washington to Pace AI

00:36:06 — The Battle Over Open Weights Continues

00:53:36 — Sam Altman on AI's Abundant Future

00:59:42 — OpenAI's Astra Model

01:03:44 — Microsoft Posts Record Fiscal Year