And then there are those who say, let me do a few years on Wall St and then I'll pursue the startup thing. What happens during that time is they lose their entrepreneurial edge (they become corporate dull) or they take on a lifestyle (nice house, cars etc = high fixed costs) which makes startup life less feasible.
Of course, in startup land, you have your occasional stellar upside scenarios a la Zuckerberg, but if economics is the main motivator, Wall St is a logical, rational choice esp if you work to live (and not live to work).
I say all of this as an NYC startup who feels this pain at times (although I think it is overblown and more of an excuse). I just don't think bellyaching about it achieves much.