In my limited experience as somebody whose friends and family are all pretty well educated and pretty well off (for better or for worse, I work at a big tech company), gambling seems pretty class-specific.

I don't know anybody who gambles, on betting or crypto, and only a small number who even pick individual stocks. Some people play poker, but only for nominal sums, and it's usually presented as more of an intellectual exercise. I get the sense that if somebody said they like sports betting, it would produce a half-second awkward glitch in a conversation. I doubt anybody would moralize, but there might be an unspoken question like "[you gamble? don't you have more fulfilling things to do?]"

The simple answer here is probably that if you already have enough money then you don't need to gamble, but it's not like most people who gamble actually believe it's the path to profit, it seems like there's something else here where gambling is viewed as low-status (in my bubble).