Something is wrong with your cert
Nope...?
@idlewords: http://charlieharvey.org.uk/page/gandi_sha2_intermediate_cer...
Are you putting the chain certs in the SSLCertificateChainFile file, and not concating them to the SSLCertificateFile?
Most of the issues Qualys points out on blog.pinboard.in are not present on pinboard.in itself, so I presume there's a difference in config there that would be a good place to start. They're also running on different versions of Debian (squeeze v. wheezy, which ship different OpenSSLs) which accounts for some of the variance.
Also, as Qualys notes, disable RC4 ciphers on pinboard.in and you're in pretty good shape.