Many patents are "obvious" before the fact, thus prior art.
But this isn't a discussion about patents like that. This is a discussion about patents being granted for ideas that are simply innovations and/or copies of pre-existing ideas. That's completely different.
Not every patent is of equal creativity, importance, and value.
If you had prior art that invalidates a patent it doesn't necessarily mean the owner of the patent owes you money.