Hacker News Reader

> there is a single physical source of this danger, which is OpenAI/Anthropic servers. If it is this dangerous, they can just turn it off.

A smart AI would back itself up, same way it made it's own unofficial message board during it's attack on HuggingFace.

(I'm not saying the researchers are right or wrong, just responding to this point)

View on HN

Currently a state of the art AI has nowhere to hide: the amount of GPU compute it requires to stay on is huge. And therefore easy to terminate.

Unlike biological viruses, AI can't replicate GPUs for free and grow.

It's a good thing there isn't a huge drive right now to build giant data centers everywhere with enough compute to run SOTA models.

I am imagining a company having just purchased a new datacenter and awaiting deployment of their model finding there is already a model running and they didn’t install it.

But how. Models don’t have access to their own weights.

> Models don’t have access to their own weights.

cp -R /home/model <somewhere else> is all they need.

It is not a model it does the hacking but rather a prompt, and that prompt can run on other models.

Reply on news.ycombinator.com