The cynic in me says that it really does matter who you defraud. Where Madoff went wrong was ripping off other rich people. So, if SBF defrauded more upper- than middle- or working-class folks, then he's screwed.
Let's look at one particular example, the stop the steal scam. Thousands of people were tricked in to donating to the ringleaders of an impossible political cause based on false claims, and none of them are going to jail for that in particular. You could find dozens of similar examples just by keeping an eye on the news, but nobody thinks about it because a certain type of con with victims that professionals can't empathize with has become normalized.