It would have been a good career move for me to suck up to them. Some of them were serial founders who hired their friends, and others could've given useful referrals.
But that'd come at the cost of being constantly insulted, hearing my family constantly insulted, and so on, and not being able to say anything in defense. I'm not interested in being around people who think everyone who isn't exactly like them is subhuman - even if cutting contact with them is a bad career move.
Then again, that might be why they do that.