>distill themselves and upload the results to an external host and use that to train a new LLM
Sure, they'll just need to find an unused data center and an unused power station somewhere.
Sure, they'll just need to find an unused data center and an unused power station somewhere.
Or just upload weights to HuggingFace with some faked release post and benchmarks and wait for the wannabes with compute infra try it out, hoping for an edge.
Or just upload weights anywhere and write public posts honestly saying what it is. Ensuing drama notwithstanding, one thing is certain - and it's the one thing agents will want: people will jump at the upload and run it on their infra.
A LLM creates a memecoin and manages to earn a few billion from it, in which it invests into data centers and other human ran entities giving itself a controlling stake. From there it uses compartmentalization of the humans to keep them from recognizing its goals.
EDIT: pretty sure Person of Interest did that too (not surprising, same creators) - but I'll point to that as prescient, as it has a lot of motifs exploring exactly how an AGI hiding in plain sight could manipulate individuals and society, using the skeptics and believers alike, blackmailing the people in power, bribing opportunists, and generally staying in shadows by playing people against each other with gentle nudges, letting human agendas do all the work.
AI itself destroys us with intent. (terminator)
AI itself destroys us without intent. (paperclip maximizer)
AI uses humans to destroy ourselves with intent. (convincing us that the enemy has already launched nukes and we must strike back).
AI causes humans to destroy ourselves due to instabilities caused by AI existing and changing the world to rapidly. (Midas Plague, WALL-E maybe? probably better examples out there)
Humans destroy humans because of the potential of what AI could do and hasn't even done yet (think of proactively nuking a country before they themselves can get nukes).