In my country, plastic bottles have returnable deposits, so they tend to not end in the dump. There are also glass bottles available.

That said, I think plastic can be OK if it is trashed adequately. I don't think my plastic bottles end up in the oceans.