LOL! Do you live in the USA?

They'll just turn down the meeting request, tell your supervisor what you've done and you'll suffer either real punishment or be unofficially 'punished'. You may even be fired because of "at-will" employment: Anyone can be fired for (almost) any reason at any time.

Generally you just don't get time off, or maybe you can take the time off without pay (if they're extra generous). Such is life in the USA, there is no response: You will do what the owners of capital say, or you will go hungry.

That's all there is to it.