Same with most other public work - let's take police. Yeah, if you are a beat cop, you've got to pound the streets. But you are a detective. Can't you say that you want to talk to witnesses and suspects from your home via Zoom? Sure witnesses might chose to visit the station, but you don't want to do interrogation in person, because you think that it can be done just as effectively from home. Or hospitals.
The more you think about it (at least in my case) the less idea of 'remote work right' makes sense. Option - yes, right - no. It simply makes things worse, not better.
If you don't understand it, try flipping the situation around. Try justifying 'the right to work from office' for a person like me (which is not totally true - I can work both from home or office, I just prefer office for social reasons). Let's say I get hired by Basecamp, which is remote only with no office. I then claim that 'work from office' is my right because whatever. It's just a type of spoiled entitled brat that am. Now Basecamp or any other fully remote company is forced to rent an office just for me and maybe a few others who also share inclination to work from the office. Meanwhile, there are a ton of 'office vacancies' out there that I could have easily applied to given my background. How is it fair to Basecamp?