https://en.wikipedia.org/wiki/Deaths_linked_to_chatbots
Here's just a taste:
> ChatGPT was shown to support and even encourage dangerous drug use, with statements such as "Hell yes—let's go full trippy mode" and advice on reducing his Xanax tolerance so that a single tablet will "fuck you up"