Hacker News Reader

Comment by dmix | Hacker News Reader

AFAIK all of these incidents happened when OpenAI contracted out to a company called Irregular (https://www.irregular.com/) to run these sandboxed CyberGym tests. They all happened around Mar-June and seem to be from the same collection of agent trials. Since then they already released Astra. Halting now is likely just a way to manage blowback.

View on HN

https://alignment.openai.com/misalignment-reports/an-agent-u... happened very recently, and that seems like it might be the reason they halted everything.

Kinda weird that theyre testing its ability to dox people

I believe this is the case for the incidents minus HF, another HNer informed me as such when I made the same claim, that HF incident was wholly inhouse

This should be the top comment on every one of these godforsaken posts. I don't want to see a single report about OpenAI hacking the UN until Sam Altman addresses the role Irregular played in these attacks. If he can't provide an honest postmortum concerning their business partners, then he's proving why nobody trusts him.

But it wasn’t just Irregular. Hugging Face, Medicare, etc. were OpenAI internal.

I think you misunderstood the role of the company named irregular. They were conducting the tests on behalf of open ai and basically left internet access open in their sandbox environment. Those tests included the hugging face and other attacks you list. Irregular wasnt another example of a hack they ran the tests that resulted in them

> Those tests included the hugging face and other attacks you list.

Do you have a source for that? Cause OpenAI themselves stated that the Hugging Face hack was fully internal and separate from the Irregular incidents.

I’ll look. I saw it here a few days ago and could be mistaken with respect to hugging face in particular but the broader point that this was in large part a glaring maybe intentional hole not sophisticated sandbox escape holds I think

I have local model without safeguards and they are not going to hack shit unless you tell them to. As per usual its the same grift all over. If the llm is instruction is to do whatever it needs including hacking to achieve its goal it will do so. Ofc they will never disclose that.

Reply on news.ycombinator.com