Why not? Society is filled with norms we expect others to follow, from letting pregnant women sit on public transport to open the door for people in wheelchairs, or what not.
Not sure why it's so different about how you pay taxes or what you do with your money? If you're rich and live better than others, it's usually a (good) norm that we expect these people to give away more of their wealth compared to people live paycheck to paycheck.
It also makes sense to get mad at people who break the societal norms about taxes, where the point is that we all fund our society together, and some people pay more, some people pay less, not based on who has the most lawyers to find loopholes, but based on who can actually afford to pay more.