I agree llms are powerful but they are not explosive - conflating the two is IMO even more dangerous
to quote none other than sama, oct 2023: "i expect ai to be capable of superhuman persuasion well before it is superhuman at general intelligence, which may lead to some very strange outcomes" https://twitter.com/sama/status/1716972815960961174
The biggest, best transformer-based LLM you could imagine, that we haven't even made yet, will still fail the basic test "what is the weather tomorrow" since a LLM has no knowledge outside it's training set.