The problem is that you cannot unteach it serving that shit. It's not like there is file you can delete. "It's a model, that's what it has learned..."
The obvious challenge here is "how do I ensure it can answer questions about this information that wasn't included in its training data?"
RAG is the best answer we have to that. Done well it can work great.
(Actually doing it well is surprisingly difficult - getting a basic implementation of RAG up and running is a couple of hours of hacking, making it production ready against whatever weird things people might throw at it can take months.)
I’m gonna add:
- I think this thing can become a universal parser over time.