I certainly agree with you in practice.

Think of this like an Einstein thought-experiment -- it's not how you should run your life every day, but it's maybe a nice foil for thinking about such things.