I completely agree with this. Short of taxing wealth or taxing consumption, like the FairTax proposal[0], there's no way around shelters and avoidance.
I find it hard to hold a grudge against wealthy individuals who minimize tax liability. It's perfectly legal and it's in their best interest.