You can choose deposit glass if you look around. A local health food store or specialty shop surely sells water in large glass containers. I live in a very rural part of Missouri (not a very progressive state) and I know of multiple sources.
You can choose not to buy a bottle of water at all. You can buy a reusable bottle and get refills.
I can also choose not to buy milk because they are no longer available in glass bottles.
I can also choose not to buy food which comes in a plastic bag or blister.