I think it's perfectly legitimate to consider the MAGA hat a hate symbol. Specifically because of what it represents to American minorities; an implicit threat.

At one time the hat represented something legitimate but Trump's first term is coming to its end. The campaign has been over for a long time now. The MAGA hat is yet another symbol that the alt right appropriated for itself. It doesn't just represent Trump supporters and Republicans at large anymore.