Human attraction is way more complicated than this
Natural Selection favors throttling the reproductive pace of individual members of a species for the overall diversity and health of the group, and to prevent overpopulation that could be ruinous to a group. Some species are reproductive for the majority of their lives, and have shorter lifespans or less abundant reproduction. Humans' relatively long lifespan and relatively short reproductive period allow us to use less energy concerning ourselves with survival and reproduction than other species.
Baldness, menopause and homosexuality are examples of nature telling us to slow down our mating activities and ideally to find other ways to contribute to the collective- like supporting the young (teach), creating persistent works (write a book), sharing resources (buy a family house), or conserving resources (die).
Primates can go bald. My understanding is that it is a positive for sexual selection.
And if humans being bald actually affected sexual selection, we wouldn't have bald men any more.