At the very best then, it'd be the way he said it (so, the phrasing) combined with the fact he's the president (or was running to be), a role which we expect not only the highest levels of decorum but also humility and respect for the citizens, and combined with the fact that just because Drake might do it, it doesn't mean it's an OK thing to do. I don't know about other people, but I'd definitely criticize anyone for not only using their status to grope people, but then to brag about it. To brag about it betrays a certain mindset and characteristic of disrespect for people, and in this case, women.
In other words, I'd think lesser of my friend for saying something like that to me, or overhearing him in another conversation. The same goes doubly for the leader of the most powerful nation on the planet.