So what you are against is rich people not paying the taxes they are supposed to be paying, not against 'higher taxes'.

I used to think like you, until I realized that the people sinking millions of dollars in every electoral campaign to push candidates friendly to 'lower taxes' are the ones who are already taking advantage of every loophole.