Your impression is likely based on what you hear in a) tech media, which is largely supported by ads and hence welcome rage-views, and b) tech forums like this where open source is the dominant religion. But count how many times you've heard of a merit-less lawsuit, and compare that to the dark matter of millions of active patents out there. Forming opinions based on cherry picked examples is not a good idea. Better to look at empirical evidence.
I'll give you some numbers less than 1% of patents are ever asserted, and only a fraction of them make it to a trial. The vast majority of patents lie fallow because there is no demand for their technology in the market. Now does that look like a serious problem anymore?