At that point, from the perspective of the rest of us, they simply don't exist. And their ASI wouldn't exist either. We would get back to the world as it was pre-ASI. One where all of us need stuff that others among us can offer, and we hire one another and buy stuff from one another. Sure, things aren't as great as they could have been. But the status quo isn't the worst thing in the world either.
The scenario that is a lot more concerning/weird is the more realistic one, where ASI makes 99% of human labor obsolete - but not the remaining 1%. At that point, the ASI owners will hold American-idol style auditions where thousands of hopefuls vie for the opportunity to be in that lucky 1%. Auditions where we beg and plead shamelessly to be chosen by the ASI owners. Auditions where the losers are left to scrounge for the 2nd hand, 3rd hand, and 4th hand scraps, that trickle down from the 1%.
I hope to god that when an ASI is built, and in the unlikely case that it doesn't simply overthrow humanity, that we will have a political structure in place that gives everyone a meaningful share in the fruits of ASI. Or that the owners of this ASI consider every other human to be utterly useless, f off to their Randian paradise, and leave the rest of us completely alone. The middle ground between these two is where dystopia lives