> That feels like a bigger problem to me than people actually getting good data but then using it too confidently
P value alone does not tell you whether you have good data. It just tells you how well a particular model fits the data that you have. It won't (and can't) tell you if your data set is missing data that would alter the P value were it to be included.
P value alone is not enough to say "good" or "bad." That's why this statement matters.