It is very easy to take the philosophical stance where every concept can be totally detached from the incentives it creates and the social dynamics it is part of. It is easy to take that stance, but it is very hard to use that stance to explain reality, because reality plays by more complex rules.
Please, always consider the status quo and the incentives involved instead of stating the surveillance equivalent of "weapons don't kill, people do".
NSA is allowed to collect any information about non-U.S. citizens outside U.S. and there are some limitations to collection of information about U.S. citizens outside U.S.
https://en.wikipedia.org/wiki/Foreign_Intelligence_Surveilla...
The US Constitution applies to people in the US, by the way, not just citizens.
It absolutely can be a problem when used for organizational or ideological gain - e.g., when used by state, religion, business, or political group to spread propaganda, suppress opposition, unjustly favor an in-group, etc.
The classic case of using mass surveillance to help a burgeoning theocratic or fascist state is a pretty standard example.