We generally don’t allow cockroaches to thrive in the spaces we claim for ourselves. Question is how much space (economic or otherwise) will AI claim for itself and whether there will be any left for us.

Individual humans are processing nodes on human culture as a whole, which runs on rather more than tens of megawatts.

Fwiw if you trained an LLM in an RL sandbox that would require it to have goals, the output llm probably would "have goals"