How does this differ from "If you have nothing to hide you have nothing to worry about."?

Surely it's not difficult for you to imagine fairly common scenarios where your equation is patently untrue. A battered spouse of LEO or a non gender-conforming individual in a theocratic society are only two really easy examples that come to mind.

If we assume that individuals who control or have access to surveillance mechanisms are universally magnanimous and actually capable of neutralizing threats to safety, then your negative relationship between safety and privacy might hold up to scrutiny. I have more than a bit of trouble seeing how that assumption is anything other than utopian.