Why do you think this is the case?
Has the government sufficient ability to secure data that the very fact they possess databases of information on US citizens isn't fundamentally problematic? Based on only the last year of breaches, I'd argue no.
> People (rightfully) dismiss as insane the notion that some weird dude is sitting in the basement of the NSA listening to the details of your life
That is not a claim that any rational critic of bulk surveillance makes. And, ya know, machine learning exists. They won't (or don't) need humans to analyze the data they collect.
> ...the whole concept is linked much more closely to the fear of shame...
Embedded journalists, activists, people with sensitive medical information.