I present on game development to local user groups in New Zealand and I always get a good response when citing "It's fun to write games - wouldn't you much rather be writing a class called SuperLaserWeapon than MembershipIdentityProvider" :-)
If you like doing bare-metal high performance coding it's one of your best chances to test your skills though, unless you're doing lolgames.
If it were just a male/female thing, you'd expect games like SimCity and Civilization to not get geek cred, since their appeal straddles gender lines.
The reason seems more to be that it's not blazing fast OpenGL 3D supernaturalistic advanced strategy/fps type of game.
People have an easier time taking themselves seriously when guns and demons are involved.
Cf. comic books, authors, goth teenagers