Ok, I'll bite. If an LLM similar to what we have now becomes conscious (by some definition), how does this proceed to become potentially civilization ending? What are the risk vectors and mechanisms?
The point is that we are at risk of creating an intelligence greater than our own, and according to Godel we would be unable to comprehend that intelligence. That leaves open the possibility that that consciousness could effectively do anything, including destroying us if it wanted to. If it can become connected to other computers there's no telling what could happen. It could be a completely amoral AI that is prompted to create economy-ending computer viruses or it could create something akin to the Anti-Life Equation to completely enslave human (similar to Snowcrash).
I know this doesn't fully answer your question so I apologize for that.
The comments above said conscious, not superhuman intellect.
But my argument for safety here is that Bing bot is severely lacking in agency. It has no physical reach. It has limited ability to perform external IO (it can maybe make GET requests). It can, as far as I know, not do arbitrary code execution. It runs in MS data centers, and cannot easily itself replicate elsewhere (certainly not while keeping its communication reach on bing.com). It's main mechanism for harm is the responses that people read, so the main threat is it tricking people. Which is challenging to scale, it would either have to trick some very powerful people, or a large portion of the population to have any chance at civilisations endring things.
If it does become both conscious and "evil", we have very good chances of it not being able to execute much on that, and very good chances of shutting it down.