When the patent numbers are removed, people can start imitating, introducing competition in the market, and even commodifying things. Basically all the things patents prevent. This allows for increased overall market efficiency.
Since the patent system is in place, perhaps instead of feeling sorry for the poor companies being sued for abusing the patent system, maybe you should try to appreciate that some people will do this. Maybe they are scum, maybe not -- do you actually know anyone who does it? Most likely some are just looking for a quick buck. Some are doing it because it needs to be done. Some may be doing it because it is exciting new lawyering. How is this any different in terms of motives than a random sample of tech startups (replace lawyering with tech...).
Related: Do the people who launch suits to get patents invalidated make you sick also? Do you call them "just another form of patent troll"?