It's true that if you don't restrict yourself to the world of facts, you can do pretty much anything. And there are lots of contexts where I'm doing things decidedly not rooted in facts, such as enjoying and producing works of fiction for entertainment. However, if we're going to talk about the nature of the world, adhering to facts becomes mandatory. Otherwise, there is not a lot of meaningful exchange to have at all. Of course it's fun to kick hypotheses around - but a supernatural world view is usually not a mere hypothesis, it's a postulate made in conscious and willful contradiction to evidence.
For instance, I like Lord of the Rings, but the moment I insist people should take seriously my belief that orcs are under my bed, I have crossed the river into the land of delusion. Of course I'm free to entertain that belief, but people publicly calling it out as bullshit is not Chauvinism, it's an honest and rational response.