Friends of mine who work in high-security finance have told me about some fairly exotic things. Desoldering USB ports. Epoxying cable connectors into their sockets (to prevent easy removal - without chance of significant cable/device damage leading to investigation of issue).
I can only imagine the stuff that goes on at places like the NSA and CIA where the stakes are extremely high.