Cue “p = 0.05 is a random choice” and a big thread about p-hacking. Any takers?
It feels like everything to say has already been said about the bias of small sample sizes and the dangers of p-hacking. But it also seems like the discussion is inevitable here.
I wonder if there’s a new insight to glean, somehow...
For a background on why p-values are misleading, see https://youtu.be/42QuXLucH3Q which is excellent. He points out that 0.05 was selected by Ronald Fischer in 1925, and people have gone with it since.