So once he's promoted, he can now email/text you all night and 'improve' your productivity.(Being Sarcastic, of course)
No, at that point you get HR involved because they are creating a hostile work environment and demoralizing the team (bonus points if any of you have significant familial obligations such as caring for an elderly parent or other relative).