Personally, I'd be in favor of banning plastics from garments as they are the single largest source of microplastic pollution and non-recyclable consumer goods on the market. But if you make plastic garments, you're part of the precipitate.
https://www.patagonia.com/our-footprint/recycled-polyester.h...
In the long run, there’s really no reason plastics can’t be made directly from recent organic matter. Starting with oil gives you an energetic boost, but if you’ve got clean energy to spare, in theory you don’t need it. In practice though, it’s hard and there is a long way to go.
It’s hard to imagine how one would get similar performance from non-plastic garments. Before plastic, top-notch outer wear was oiled cotton canvas. But you are right about microplastic pollution.
That process starts from a lower energy level than starting from methane or oil, and so overall its more expensive. We would have to be willing to commit to generating a "surplus" of carbon-free power (e.g. nuclear, wind, solar) to support that sort of manufacturing, but it would be possible.
Also, a great thing about running electrochemical processes off of a periodic energy source like solar or wind is that the economics are easy to load-shift -- you care about the aggregate work output, not the consistency of work output.
North face still has plenty of cotton and wool options.
Buy maybe you don't burn tons of oil in cars and planes you can maken a shit ton of plastic jackets without spewing nearly as many greenhouse gasses.
Decarbonize doesn't mean we have to use 0 oil, it means we have to use way less.