this goes the other way too, AI that trains on data from humans, well you're going to get the same sort of reliability haha

We get the best results from neural networks on closed systems with an infinite supply of training data (think how successful alpha zero was at chess, it simply trained by playing games if I'm not mistaken.)

Neural networks are an incredible tool. AI as a chatbot trained on human input is going to probably just simulate a lower quality human being that hallucinates more than normal lol