This is absolutely mindblowing. I understand that these LLMs are essentially "really smart autocomplete", but it's crazy to me how could Bing/Sydney could actually go this far to seemingly express emotions and desires. It's like they gave the AI a personality (that, yes, can go unhinged, although that's almost misses the point).

It really feels like he's interacting with a person here. How can they do this??