Assuming something isn't valid because it contains a fallacy is in and of itself a fallacy. Ad hominems are used all the time in extremely valid ways.
Take what he said in spirit, instead of literally.
Take what he said in spirit, instead of literally.