You'd have to be trying really hard (read: on roids) to be anywhere near a situation where adding muscle or cutting fat makes you less attractive.
However in these days of endocrine disruption and secular testosterone decline, it’s not unreasonable to assume that anyone dedicated enough has at least considered gear.