You can (which is not, necessarily, to say do) know if the compiler is tweaked: http://www.dwheeler.com/trusting-trust
This only works if you are building things yourself or trust the group building things, of course, but it's way easier than audit by disassembling binaries.