Environmentally plastic is definitely worse, but the quantity of plastic used is tiny compared to the rest of the oil industry.
The moral benefit comes from not farming animals to only use their fur. It's cruel and wasteful, and we have synthetic fur that's actually better than the real thing for warmth. The reason real fur is still used is because it's cheaper, which should tell you a lot about the conditions the animals are farmed in.