I experience something similar. When I have a beard I can't look at myself in the mirror because I think I look like a bum, but everyone (both men and women) are more friendly and pay better attention when I have a beard.