Just because you can theoretically perform your job from the location of your choice doesn't mean you have a right to restitution for doing it somewhere else.
Your employer has a right to set their terms of employment and you have a right to tell them to pound sand if you don't want to abide by them.