Nope. You hoarding wealth won't make the neighborhood less appealing. The hoarder is not free loading.

New wealth can be created, we don't need yours. If your investment real estate is contributing $1/square foot in property taxes but everyone else's occupied property is contributing $5/square foot in wages, sales tax, property tax and municipal fees... then it makes sense to charge the free loaders. This isn't even dealing with the blight and community development points. Just from a financial perspective it makes sense.

Assuming you're talking about money, actually no. Money doesn't have any associated geometry or topology, ie one bit of money, unlike land, is pretty much equivalent to another. It would be like "hoarding" a bunch of land in the middle of nowhere: only a problem if you're taking up a significant fraction of the global supply.