Finetuning is not useful for teaching new facts, the current solution for that is using RAG: https://zzbbyy.substack.com/p/why-you-need-rag-not-finetunin...