Kaczynski was essentially a blackpilled fascist. He spends the huge bulk of his manifesto ranting against leftism. I think its fine to attack the ideas as well.
You must have missed the memo that defines "fascism to be anything someone more conservative than AOC believes in.