One significant reason I don't want the government collecting all of my data is because they seem totally incapable of creating a secure system or even a system that operates properly.
The NSA seems technically capable, though. (They seem to get the best of the best software engineers / IT people.) Not that it's good they have it, but at least they can keep it safe from outside attackers.