Another issue is the nature of the reflection. In a glossy screen, the reflection often is a mirror effect that, at least for me, is easier to ignore. Reflections in matte shine up the surface's tiny individual indentations and that blocks more of the screen under it.
And what about screen protectors? You can make a glossy screen matte with one, but not the other way around.