There are strict rules that define when something is "statistically significant", it's not at all arbitrary. The problem is people thinking that just because something is statistically significant, it is automatically true. Which it isn't. Statistically significance by definition includes the possibility that something was just a statistical oddity. This article essentially just reminds people of that, and urges them to abandon the "statistical significance is the same as ultimate truth" conclusion.