The point I'm making is that if you open the envelope you will always conclude that it's advantageous to switch regardless of what you see in that envelope. In the case where you see $1, you're guaranteed that switching is a good idea. If you see anything other than $1 you come to the same conclusion but you have to rely on a probabilistic argument using expected values. Now, if you will decide to switch regardless of what you see in the envelope, then why even bother opening it? But, if you don't open the envelope, then you're back to the original problem where the symmetry argument is valid.