The problem is that there were lots of folks hired with the explicit promise that remote was here to stay. This is at best a rug-pull; IMO it's like your salary suddenly being slashed by 20% a few months after you started with no explanation. It's not technically illegal in most places, but it certainly feels really bad and makes me sure I never want to work there.