Do you have a larger set than just famous assholes? Its entirely possible they represent the exception and not the rule. In fact since they themselves then to be extraordinary I would believe that they are influential in spite of being an asshole instead of because of it.