I think calling Trump supporters dumb is a different problem from a poll being wrong. Rather are polls wrong if they X has a high chance of happening but then x did not happen?
It seems like most people on both ends of the political spectrum create a media-fed bubble of bias, and when the outcomes disagree with that bias (as in the case of Trump) it can create pretty damaging cognitive dissonance.