It would be a trade-off. It would be more immersible for you, but less for everyone else, as your only only human appearance (your face) would be obscured.
Longer term solution: Your presented face would be computer animated.
Longer term solution: Your presented face would be computer animated.
Replacing the video feed of a person's face with a computer generated, almost-their-face-but-not-quite simulacrum sounds like it'd heavily increase user nightmare rates.
Headphones would probably be a big help though.