I do not understand this. That was the reasoning given by my previous employer as to why folks had to come back to the office as well, and it just doesn't hold up to close scrutiny.
Delineation of duties and clear expectations is sort of step 1 of managing people. Some people have jobs that can be effectively done off-site, and some do not. It's just a matter of sitting down with folks and outlining what and why.
If they disagree, you provide an avenue for evaluating the business case they have, other than 'I just prefer it'. If there is a compelling case to be made, let them make it and quantify its positive impact on the business.
I just don't get that statement, at all. I didn't three years ago, and I don't now.