>I realize this seems abstruse, but the fact pattern is very important in common law judgments.
You're basically assuming they would have to redact everything. Just replacing names and addresses with tokens that don't identify the specific subjects would get you most of the way there unless the specific fact pattern is unique to the suspect, and then you can redact what is necessary to make it less specific.
In addition to that, once any given investigation is over the opinions and redactions that were held secret for the purposes of that investigation should be published, and it shouldn't be so easy to keep things secret for decades just by making a facile claim of national security.
>9/11 only involved boxcutters, but I'd say that it presented a rather significant national security problem when those turned out to be sufficient to hijack planes and fly them into high-value targets.
9/11 was not a national security problem. 9/11 was a mass murder. It was shocking but we have inflicted more damage on ourselves in our overreaction to it than the terrorists did in committing it. More have died avenging the victims of 9/11 than died on 9/11.
A national security threat is a nuclear bomb, or a plague, or a foreign government infiltrating high level government offices in preparation for some kind of Communist takeover. Something that would be a factor of 1000 worse than 9/11 and present an actual threat to the security of the entire nation. This watering down of "national security threat" to mean any jerk who might kill some people with an IED is just a ruse to rationalize the use of extremist measures against everyone rather than taking into account the proportionality of the threat.
>You're also ignoring the fact that many kinds of low-level terrorist activity aren't open to direct investigation by law enforcement. For example, suppose you pick up signals about a plot involving Mr X, who has not yet arrived in the US but whose phone number you have managed to identify. If he's in a country that's friendly to the US you might be able to get their law enforcement people to investigate him, but if not then it's logical to monitor who he communicates with for prophylactic purposes.
So get a warrant and conduct surveillance on him then. That's not the same thing as spying and collecting data on everyone "for prophylactic purposes" at all.