I wonder how often or how fast it would get back on there once it stops being removed? Maybe with the typical life events that trigger it? Buying a house, new drivers license, etc. etc.
If you want to be horrified, use a different email address for each service. I have a domain that I configured to forward to me, so for example if I got a loan through Hacker News Home Loans, I'd give them email "hackernewshomeloans@example.com" . Doesn't work for everything, but it is a good eye opener.
IIWM I think the benefits outweigh the cons of dropping the monitoring, but others may have different situations/priorities.