Yes, when I began studying CS I got hit with this pressure really hard. It definitely gave me the feeling that I didn't belong in the field. It is like a cousin to Impostor Syndrome. Instead of feeling like I'm incompetent (though that still happens sometimes), I feel like I shouldn't be in the field since I don't care enough about it to work on it more than 40-45 hours a week.

Three years into my job, I'm mostly over it. I still have to deal with coworkers laughing that I use Windows on my personal computer, but at least I can eat the cake I made this weekend.