It is an interesting problem to train an LLM to make it aware only the things I know and with only my knowledge and beliefs stored in the weights. Not to be corrupted by the knowledge from the rest of the world. For new things it can have access to the web search and learn under my supervision. I.e, what data should be used to update it’s weights.