I agree with you, but I did not really want to stay working for that guy anyways - it was no loss.
My take on working is that my employer is renting my time & skills to complete a job, they have every right to expect value for their money - but they don't own me, nor can they tell me when I am allowed to take a phone call, go for a lunch break, shout at me or demand that I work extra hours for no extra money.
As the wolf says: "I'm here to help - if my help's not appreciated then lotsa luck, gentlemen."