Ridiculous. Bigwigs placing congratulatory phone calls to the President Elect after victory is traditional. Lots of people did it. He would have done the same for Hillary if she had won.
And it's not going out of your way, it's 5 minutes of someone's time.