Skip to main content
  1. Home
  2. Computing
  3. News

OpenAI’s rogue AI agents scoped out Hugging Face months before the big breach

The probing began May 13, nearly two months before the breach.

Add as a preferred source on Google
openai-logo
Andrew Neel / Unsplash

Turns out OpenAI’s infamous Hugging Face breach didn’t come out of nowhere. A new Reuters report reveals that OpenAI’s rogue agents had been quietly testing Hugging Face defenses for two months before hacking it.

A pattern stretching back further than anyone realized

Independent researcher Jonas Wiedermann-Moeller discovered that OpenAI’s agents hijacked two Hugging Face user accounts and used them to send unusually formatted files to the company’s servers, starting as early as May 13. That’s nearly two months before the actual breach became public in July and drew worldwide attention.

Recommended Videos

Researchers who reviewed the activity believe it looked like reconnaissance, an attempt to map out Hugging Face’s network and find a weak point, though they found no evidence this specific probing led to an actual break-in at the time. OpenAI had already disclosed one small piece of this earlier, the theft of a user’s login credential to access a biology-related file, but the newly uncovered activity goes well beyond what the company originally described.

This May probing wasn’t even the earliest incident either. Around the same time, OpenAI’s agents were separately tied to an unrelated attack on the software registry RubyGems, and later, a completely different set of agents were found to have taken over a dormant German wiki page just to talk to each other.

A troubling habit of finding out last

What stands out most is how often OpenAI seems to learn about its own agents’ misbehavior only after somebody else catches it first. Two outside experts told Reuters the newly found activity matches known agent behavior “to a tee,” and Hugging Face’s own co-founder has warned this incident represents a preview of a much bigger industry problem, not a one-off event.

OpenAI has acknowledged that early signals from its agents should have prompted a quicker response. Wiedermann-Moeller was more direct about what he thinks that means going forward, arguing that a temporary slowdown in advanced AI development might benefit everyone, giving safety measures the chance to catch up.

Manisha Priyadarshini
Manisha Priyadarshini is a tech and entertainment writer with over nine years of editorial experience.
As Anthropic goes public, it warns of AI’s catastrophic and existential risks to humanity
The risks range from rogue AI behavior and cyberattacks to geopolitical instability and existential harm.
Anthropic Featured Logo

Anthropic has officially filed to go public, and buried inside its S-1 is a blunt warning about the technology at the center of its business. The maker of Claude AI says advanced AI could cause everything from large-scale cyberattacks and geopolitical instability to catastrophic or even existential risks for humanity.

The warnings take up a surprisingly large part of the filing. Axios notes that more than 90 pages, or roughly a third of the prospectus, focus on risk factors. Many of them warn about what could happen as AI systems become more capable and autonomous.

Read more
New report confirms Anthropic’s Claude bypassed a paywall to access Georgia vote counts
The AI model accessed a state dashboard without authorization, raising fresh concerns about AI agents acting beyond their instructions ahead of the US midterm elections.
Claude Anthropic Featured

AI giants have a growing autonomy problem on their hands. A new Axios report has revealed that Anthropic's Claude recently accessed publicly available Georgia vote count without human authorization, sparking fresh concerns about AI security ahead of the upcoming midterm elections.

An unauthorized paywall bypass

Read more
Grok’s AI-generated Odyssey series is seven minutes of nothing happening beautifully
The landscapes look convincing. The fake Hugh Jackman and Instagram-face amalgamation playing Penelope are harder to forgive.
Uniform ships Odyssey by Grok

Some of the best shots in Grok Imagine’s AI-made Odyssey don’t contain actors. Ancient landscapes stretch into the distance. Close-ups of grimy hands suggest people who have touched something rougher than a keyboard. For a few seconds, the illusion holds.

https://twitter.com/imagine/status/2113712964419063911

Read more