> It's not a coincidence that I train a model on healthcare regulations and it answers a question about healthcare regulations
If you train a model on only healthcare regulations it wont answer questions about healthcare regulation, it will produce text that looks like healthcare regulations.