They were all able to name professional cyclists of the time who were known by them not to be doping.
People disliked Armstrong not just because he cheated but because he did things like force other members of his team to to dope and fired those that wouldn't. At the same attacking their reputations so that they couldn't blow the whistle on him.
Armstrong wasn't the fall guy because he was famous he was the fall guy because he was the instigator.