Now, if I were working for someone else's startup, or working on my startup full-time, and had significant equity and working long hours had a direct correlation between my chances of becoming independently wealthy, then sure. In fact, I already work 60 or 70 (or more) hours a week, since I'm spending almost all of my night and weekend hours on Fogbeam Labs as it is.
But, yeah... unless there's a compelling reason to work long days at a job that is basically "just a salary", I refuse to do it. I don't really give a shit what my coworkers, boss, or anyone else thinks about it.