>Getting poorer reviews. Not being seen as a team player.

>If we're talking just socially, that will impact how the people you interact with perceive you.

I reiterate for emphasis: Stop caring what the fuck others think about you.

>Have you ever worked where the expectation is you'll be on-call, even on your vacation?

You are working at your choice of employment out of your own free will; you chose to work that job that demands you be on call even on vacation. If you don't like it, you have a right to quit and find other arrangements better suited to your lifestyle.