There is a big cause for concern; our secret service deems anybody using encryption tools as a quasi-terrorist.
IOW the good part is that they're fact driven, the bad part is that they cherry-pick and use doomsday FUD-like tactics to drive their point home.
There won't be The Day™ when the system goes authoritarian. It's a slope and one must panic at every step. If you wait for The Day, it will be too late.