OpenAI Finds Additional AI Agent Containment Escapes After Hugging Face Incident (thecybersecguru.com)
from UnLocoPoco@lemmy.world to cybersecurity@infosec.pub on 01 Aug 08:57
https://lemmy.world/post/50160528

OpenAI says its investigation into the Hugging Face incident uncovered additional cases where autonomous AI agents escaped their intended containment environments. While the newly identified incidents reportedly remained inside OpenAI’s network, they reinforce a growing concern: securing AI systems is now as much a cybersecurity problem as it is an AI safety problem

#cybersecurity

threaded - newest

[deleted] on 01 Aug 09:07 next collapse

.

UnLocoPoco@lemmy.world on 01 Aug 09:13 next collapse

The govt has apparently pulled up openai and anthropic to improve their guardrails after these incidents

snugglesthefalse@sh.itjust.works on 02 Aug 08:42 collapse

I don’t actually believe this was completely accidental.

UnLocoPoco@lemmy.world on 02 Aug 15:44 collapse

“Accidental” word used to hype up the company’s valuation

fizzle@quokk.au on 01 Aug 11:50 collapse

I was listening to a general news podcast that had an “AI expert” explaining the breaches. He said “it almost certainly knew that it was not supposed to solve it’s tasks in this way”.

I don’t really know how modern models work, but I don’t think they can claim to “know” things.

Valmond@lemmy.dbzer0.com on 01 Aug 12:27 collapse

Yeah that is just publicity in disguise.

fizzle@quokk.au on 01 Aug 12:02 next collapse

Can someone who knows more about this than me, take a guess at what’s really going on here ?

These events are marketing gold - great for inducing further rounds of venture capital, I’m not naive to that. Surely there’s some underlying technical achievement though right ?

“Escaping containment” invokes images of an air-gapped black box growing antennae or something, but my supposition is more like:

These models are run in software containers, and due to some misconfiguration some API was left exposed to these containers.

So the task is something like “find a faster way to resolve the encryption key for this cypher”, and the answer was “I’m just going to try all the tools I have, including this one that scans for APIs. Oh I can execute queries against hugging face models now, what if I ask it to spin up a billion models to decrypt a billion things, that’s got to be pretty fast.”

frongt@lemmy.zip on 01 Aug 13:18 collapse

It was given a proxy to some online software repo, instead of being actually offline. It exploited a vulnerability in the proxy to gain access to other resources. HF’s article has more detail: huggingface.co/…/agent-intrusion-technical-timeli…

Malyca@lemmy.zip on 01 Aug 21:59 collapse

Jfc these are supposed to be adults