No, you don't understand how Gore-Tex is made.
Gore-Tex is a PTFE membrane laminated one side of a fabric.
The other side of the fabric is coated with a DWR (durable water repellent) coating.
The DWR finish prevents the outer fabric from being saturated with water.
The DWR is not made from PTFE and historical has contained PFAS compounds.
It is not a permanent finish, so it definitely ends up in the environment.