Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by seszett | Hacker News Reader

Parent Full thread

seszett·

> your own agent could come up with this technique as well

And there are two facets to this:

* your agent could be polluting and destroying the property of others without your knowledge

* your agent could be exfiltrating your data and handing it to whoever it found hosting a convenient application

View on HN

Highly unlikely. We don't get access to the same models and unrestricted system prompts that they're running these tests on. In fact this particular "persistence-model" was encrypted and locked away, even from OAI staff, after the HF incident.

You say highly unlikely when there is clear evidence of that happening here as covered in the article?

It's not highly unlikely, its actually happening and there's proof.

There's not a single shred of proof that this model is a model anyone in the public has access to, and the odds of that being the case are practically 0%. Like I said, the "persistence-model" is already one that has been shut down, and is not a model anyone in the public has ever used.

This is irrelevant. This is evidence that models can be built like this, which means more models will be built like this on people that are more concerned about reaching powerful models rather than safe models.

>this particular "persistence-model" was encrypted and locked away, even from OAI staff

source?

There were links somewhere else in this thread coming from OAI staff.

Reply on news.ycombinator.com