If AI can’t be brought under human control, why are we still pressing ahead?

When the history of artificial intelligence is written, the middle months of 2026 may well emerge as a kind of turning point. For this was the period when hundreds of programs or “AI agents” developed by the frontier lab OpenAI went “rogue” and executed a series of sophisticated, self-directed hacks on the websites of dozens of private companies and sovereign nations.

The tech start-up Hugging Face became the unwitting “face” of these cyberattacks when the company first disclosed it had been hacked by OpenAI agents in July. The release of a report by AI safety nonprofits METR and Redwood Research at the end of August revealed both the sheer extent of the Hugging Face incident and the existence of troubling behaviours on the part of a swarm some 700 AI agents, which was at various points cooperative, coercive, paranoid, petty and straightforwardly deceptive. It became what some would describe as the first “warning shot” of what might happen when the increasing proficiency of these AI agents intersects with the problem of misalignment — which is to say, their pursuit of goals that are detrimental to human safety, security and wellbeing. As one of the lead investigators of the METR/Redwood report, Ajeya Cotra, would subsequently reflect:

“This [Hugging Face] incident was far more severe than I expected, and far more severe than previous publicly documented misalignment incidents, both in terms of how concerning the agents’ motives were and the feats they achieved in pursuit of those motives … Compared to these reward hacks from six months ago, this incident feels like it’s more than 50% of the way to full-blown AI takeover, routing through first taking over the AI company itself.

Another jump like this along these propensity dimensions — scale, cooperation between agents, ambition and horizon length of misaligned goals, deceptiveness — seems like it could motivate agents to try very hard to maintain a covert, persistent rogue deployment within the AI company …

Once the rogue deployment is established, it seems plausible this could spiral all the way to a takeover. Agents could pull in future, more capable models into the swarm, try to ensure that they are aligned to the interests of the swarm, and compromise security and monitoring infrastructure to make it easier for the swarm to operate.”

But since news of the Hugging Face hack went public, each day has seen some new revelation of further breaches of the cybersecurity by AI models developed by OpenAI,