What specific glasses are these? I'd guess that the direction of the polarisation of the glasses makes a big difference
"Vertically polarized light is preferentially refracted at the surface, so that the reflected light is left more horizontally polarized" and you use vertically polarised sunglasses to filter out the reflected horizontally polarised light.