Thinking you have a secure connection when you don't is worse. On (generic hostile network), thinking you can check your mail safely is worse than knowing you can't.

I am not going to argue for the correctness of this position, but presumably it's because the "secure" icon (e.g., the little lock) is absent.