I think it is part of a more general problem: people do not spend much time thinking about the importance of any of their rights. Nobody wants to hear that a terrorist attack was successful or that a criminal walked free for the sake of their civil rights -- rights are abstract, terrorists and criminals are threats to our children and whatnot. Look at what people say about free speech rights, how quickly everyone parrots the quote about shouting fire in a crowded theater (most people have never bothered to look into the Schenck case, they just know that one phrase). People have even managed to say that habeas corpus rights are problematic.

Privacy rights are too abstract for most people to bother with. After all, they have nothing to hide, only criminals and terrorists would bother hiding anything (or so the thinking goes).