If you look at the kind of person who makes massive donations to politicians and initiatives that are about massive tax reforms (think Missouri's recent ballot question about introducing a state sales tax and eventually sunset its income tax) you'll notice that a lot of them are very wealthy people who have very, very few people that they have to answer to in their lives. The one exception, it would seem, is the tax man, and they absolutely hate that.

Market forces like inflation aren't a person exerting control over them. They're the results of humans acting within social structures. These people have control over social structures; they're the elite. They can counter that market force with some other market force. Taxes? That's cold, hard math. There's no way around it, no feeling of agency to be had. So while it might be harder to avoid, it's not the financial effect that they worry about, because they have enough money to weather that. It's the feeling of obligation and powerlessness in the face of others that they can't brook.