> Get rid of the unsafe factories and poor people won't be able to afford clothes anymore
poor people have always been able to afford clothes, it was called saving for a while to buy a good pair of pants and mending it for many years until it pretty much fell apart.
Poor people would not be able to afford new clothes all the time, sure, but clothes in general most certainly.
And let's not forget about thrift stores, go into any goodwill and you will be able to buy plenty of good quality extremely lightly used clothes for very little money.