True among people on the same "side" of the political spectrum too. The Tories' brand of authoritarian conservatism is much more dangerous than Westboro Baptist Church, for example. You can find Westboro advocating plenty of outrageous things, but they aren't in charge of a country.
So from the conservative conferences I've attended, the general sentiment is that people DON'T want an authoritarian government watching them. Further right into Nationalism is where you get the "if you didn't do anything wrong you have nothing to hide" mentality.
May, as Home Secretary, made the laws that give the UK government 72 hours (IIRC) to read your personal email and 3 months to see all the subject lines / senders / recipients.
To be clear: I'm not advocating voting for Corbyn by the above.