It destroys a lot of men emotionally, as well. It's just not healthy for anyone. The detached "alpha male" is an anachronism in civilized society, and the terms for those with strong alpha tendencies are "psychopath", "narcissist", and (for women) "nymphomaniac". Psychopaths (of both genders) can do it without emotional harm to themselves, and there's a much wider pool of people who are in denial about the emotional consequences... but the rest of us aren't built for that type of "relationship".

So, in truth, there are people who can have casual sex without being "destroyed", but they're rare and usually not very likeable. Most men I know who have had one-night stands regret them.

The broader issue with casual sex has nothing to do with the immediate emotional effects, but with the long-term consequences. It establishes bad emotional and physical habits, but it also makes people less desirable as marriage partners, and most people want the option, at least, to get settle down and get married one day. Most people are fine with "premarital" sex, given that we're a generation that tends to marry very late, but casual sex is an unspoken divide among young people today. We have about 40% of the population-- a relatively stable proportion across levels of socioeconomic status and education-- going off and doing this in their teens and 20s, expecting there to be no consequences because birth control "solved that". (Riiight.) Then we have a "silent majority" of about 60% who have never had casual sex, see no reason to respect it, and consider such experiences distasteful and extremely undesirable in future marriage partners. My observation is that nearly all of the marriageable women are in the latter category, and that men who have lots of casual sex in their 20s end up settling down with second-rate women when they're looking to get married. True ladies don't want to have anything to do with them. (Sorry, but it has to be said.) These are the later-in-life consequences for men who have casual sex; for women, they're probably worse.