So let them? What's the deal, why can't we have a society where people who want to work from home, do so while those who want to work remotely do so as well? I do know that I am deciding for myself (100% remote).
Cannot see any fault in this argument.
And no, the end result is not the same if in reality one is more productive then the other.
Could it not also suggest they have significant real estate holdings?
Edit: and return to office bas been used as a way to get rid of some people without having to terminate them.