Yea exactly, no amount of exercising will change your height as a man or the way you look.

E.g All else being equal, you're going to have a hard time finding a partner if you are 5'5 male.

Unfortunately, unattractive people will have to put in a lot more effort to succeed in life, especially with regards to dating.