Frankly, no, sweatshops are not important to the cultural fabric of a country.
The US has problems with housing affordability, with medical costs, and with service sector costs emerging from Baumol's cost disease, which are all things that will get worse with tariffs, ranging from higher construction costs, to higher pharmaceutical prices, to less service employees making the cost disease worse.
It's also untrue that comparative advantage only benefits capital. Consumers are hurt by higher prices and less job opportunities driving down demand on the labor market. This worldview of a zero sum contest between capital and labor is a populist fiction.