You are attempting to use a fallacy called an "Ad Hominem".
https://www.csus.edu/indiv/g/gaskilld/criticalthinking/six%2...
https://www.csus.edu/indiv/g/gaskilld/criticalthinking/six%2...
Note: I have provided an example by saying this.
Even though this might not be the strongest argument from a purely logic point of view, it can still be a valid critique on the author.