Defamation is a crime, the fact that his listeners harassed people because of that defamation makes it even worse.
(Note that it's important that the statements are false, and depending on some details, that either they were known to be false at the time, or that there was a reckless disregard to the truth, i.e. no effort was made to determine if they were true or false. If you state something that is true, or is false but you had good reason to believe is true, or that is merely an opinion, then it's not defamation even if someone harassess them or worse)