I think for demanding jobs the distinction between remote and in-office is non-trivial. If you expect people to push themselves to (and past) the limit, coming into the office and handling all the interruptions that entails is an enormous source of daily friction.

We hear so much hand wringing about the loss of 'hallway conversations,' but few people seem to discuss the loss of productivity from high performers in particular. I was at an intense startup when the pandemic hit, and switching from in-office to remote was such an unlock. I had an additional ~90 mins a day, could wear whatever, and just focus on executing.