Current LLMs will always have to deal with garbage in, garbage out, issues. Perhaps in the future the industry will shift left and whoever is guaranteeing the data accuracy/quality that feeds the models will become increasingly more powerful
I'll just note that GIGO is very much a problem with human teachers too. There is significantly less overlap than we'd like between the sets "Teaches X" and "Can successfully practice X".