We had many examples of AIs which tried to learn from feedback in the public domain. They all quickly becoming racist nazis for some reason.