Just remove it completely. We somehow survived without it 60 years ago.
Progress is about making good tradeoffs, not about picking perfect solutions. Otherwise your logic could get rid of any innovation by ignoring its benefits and saying "it has some problems so let's get rid of it altogether, we somehow survived without it in the past".
These things (including plastic) all have widespread costs and widespread benefits. Let's try to find ways to reduce the costs without entirely ignoring and losing the benefits?
60 years ago we were putting way dumber contaminants in our bodies.
The paint on your walls is plastic, as are your sewer pipes, probably water pipes, the insulation in your walls, the glue such makes up structural members of your house...