The actual outcome. The fact this post is even being commented on - that hackers have discovered a way to influence the models - is but one small proof. The vast majority of data coming out of LLMs these days is truthful enough that you're going out of your way to argue that this special case is noteworthy. The idea that the ingestion of data is "uncritical, and based on the assumption that all data is of equal quality" is ridiculous
So they went out of their way to turn off the magic good useful data that isn't being manipulated switch here but the rest of the time it's fine? Seems like a lot of effort to go to.