The most common argument is that it increases CPU usage on the server, though Google debunked that somewhere.
http://www.imperialviolet.org/2010/06/25/overclocking-ssl.ht...
"If you stop reading now you only need to remember one thing: SSL/TLS is not computationally expensive any more."