They were abused for a long time and we did nothing. The difference was you had to physically tap the line while the call was taking place, and then physically listen to the entire call.This placed enormous limitations. Now you can automatically store everyone's calls (translated to text), and search the entire database with a keyword search.
But this is one of those things that, sadly, few people outside of places like HN have the slightest understanding of.