If you look at timescales large enough you will find that plenty of extinction level events actually do happen (the anthropocene is right here).

We are living in a historically excepcional time of geological, environmental, ecological stability. I think that saying that nothing ever happens is like standing downrange to a stream of projectiles and counting all the near misses as evidence for your future safety. It's a bold call to inaction.