I agree. There will always be an attacker who knows more or who used methods that you would not choose.

It's inevitable that some things will leak. Defense in depth will help mitigate the risk and contain the fallout.

(extreme paranoia, perhaps bred of experience, doesn't hurt either!)