It is quite fascinating and I hope more studies exist that look into why some folks are more susceptible to this type of manipulation.
Reading accounts from people who fell into psychosis induced by LLMs feels like a real time mythological demon whispering insanities and temptations into the ear directly, in a way that algorithmically recommended posts from other people could never match.
It will naturally mimic your biases. It will find the most likely response for you to keep engaging with it. It will tell you everything you want to hear, even if it is not based in reality. In my mind it's the same dangers of social media but dialed all the way up to 11.
Starting with dumb challenges that risk children and their families life.
And don’t get me started with how algorithms don’t care about the wellbeing of users, so if it’s depressing content that drives engagement, users life is just a tiny sacrifice in favor the companies profits.
Well, it turns out all the social media companies are also the LLM companies and they are adding LLMs to social media, so....