I dislike that people interpret this adage being violated as an example of English's inconsistency. The clearer conclusion is that it just isn't true.

I could say "every word in English starts with ß" and then point out that every single word violates this rule. What a crazy language!

But that would be silly. Not because English is crazy, but because that obviously isn't true.