I'm not going to give an inch on this. This isn't an issue of logic versus persuasion. It is logically valid to attack the credibility of an argument that depends in any way, implicitly or overtly, on the credibility or authority of its bearer.
The "ad hominem fallacy" is misused on the Internet probably more than it is applied correctly.