Some users might not like my font choice either, but I don't think the browser should judge my site to be inferior because of that.
So in order to show an alert whenever sites that should be encrypted aren't, you just have to show an alert all the time. The SSL everywhere movement and Let's Encrypt are about making encryption easy enough for sites like yours that it's practical to do that.
Basically, your site being encrypted, even if it doesn't specifically need to be, helps to improve security of the web as a whole.