My advice to anyone else in this situation is to do just that. The first time abuse happens, just walk out, have a laugh about it (it reflects on them not you), and find another gig. There are a lot of great jobs out there.
I have a lot of empathy now for all the crummy jobs where people don't have that agility to move - we are really privileged in that we don't have to put up for this.