That would also invalidate the civil rights act, as the (similar) 19th century CRA was already struck down because the 14th amendment binds against discrimination by public not private actors. The reason why the modern CRAs weren't also struck is because they rested on the laurels of Wickard v Filburn declaring the CRA (this time) is about regulating "interstate" commerce.