> So the only way this is "waste" is if it's depleting the aquifer faster than it replenishes. That's possible of course. But unlikely, because NYC has been huge for hundreds of years now. If they're depleting aquifers it's only very slowly.

This is exactly the case. NY/NJ are depleting the groundwater faster than it comes back, but not at a great rate and it is nowhere near a problem yet.