Most businesses struggle to stay afloat without adding racial discrimination.

I suspect almost all such businesses would die quickly.

So yes, there would be such public disgust and stigma that even those patrons who valued such a business would hopefully hesitate to expose their bigotry.