It’s cute, but not a very practical philosophy though. Most valued resources are physically finite. Who decides how beachfront properties are allocated? Who decides who should clean the toilets?
With money, all actions take on a dimension of moral hazard. You pay for a thing, but you do not do the work, so you don't know how it is done and what effect the work has on the worker or on the world at large.
If the altruistic angle doesn't appeal, consider the selfish angle: money divorces you from the reality of an act, making you less able to do for yourself.
Like the Amish, I suggest that you carefully consider what you pay for and why, rather than just decide based on whether you can pay for it.