Yep
The idea that people who "hit the gym" might differ from those who don't psychologically, precisely because of either the physiological results of working out, or the resulting social standing that results from being judged as attractive or dominant, scares some people. And to engage my own personal pattern recognition, the people it scares the most are those who are judged as not physically appealing or imposing, and perhaps would benefit from "hitting the gym."