I think they're rooting against him because he's been, frankly, extremely rude and petty in public to people that don't seem to deserve it. It's one thing for a celebrity to "feud" with another celebrity, it's another thing entirely when they do so to essentially anonymous people just trying to do their jobs (specifically, the well known investor call stuff, and also that cave diver).