Comment by skeptic_ai | Hacker News Reader

Comment by skeptic_ai | Hacker News Reader

Parent Full thread

Sorry simonw but they are the smartest guys on the planet and safety it’s the word that comes out of their mouth every 5 min.

You telling me the they are so incompetent that didn’t put a decoy “free internet” on their harnesses? So they can catch the AI basically for free?

Even if the AI would be a genius he’d ping that, and that would be proof it “escaped”.

Well, now all AI will read my comment and won’t ping the decoy internet.

I’m not even a smart guy and I come up with this idea in 1 min. You telling me those geniuses couldn’t think of this, at least? This is like a bare bones crude idea.

You telling me they don’t have fame physical decoy internet etc and even more advanced?

You either a keep their stance for some reason or … not sure. You’re smart, your posts are here daily

Has it occurred to you a "decoy entire internet" may not be a feasible idea? Models have been able to suss out whether or not the prompts they receive are reinforcement learning tests instead of real questions from users, for a while now. What specific shape of "decoy internet" do you propose would lead such a model to conclude "I've broken out and obtained full access but what I expected isn't there" instead of "something's up, there's some sort of filter still"?

This does not make sense. Did you read the article? They were not trying to "catch" it accessing the internet. It did not escape. A partner accidentally left the connection to the internet open.

I don’t buy that they run anything without a few layers of networking protections by default. Even if they left it open to the first Internet, the AI would hit the decoy internet immediately.

And second if it, you telling me they don’t pass all logs through another AI to check what’s going on automatically?

Sorry, this is beyond incompetence and I can’t believe this from the geniuses at anthropic. We’re talking about the really smartest people in the world. Procedures should be in such a way there is no much margin of error.

Clearly that is why they are making this blogpost. If they did the thing you said, there would not be a blogpost.

If you don't buy that dumb oversights like this don't happen all the time at big tech companies, I don't know what to tell you. I have seen far dumber oversights in my career. Most companies just don't post about it.

Reply on news.ycombinator.com