At the end of the day, the financial industry is all about making money. If you do a good job, it means you and your customers get rich, and some other shmuck out there gets poor. Unfortunately, it's a zero-sum game. If you do well in the market, it has to be because someone else is doing poorly. Either that, or the market is bubbling upwards ahead of a crash.
I kinda want my life to be meaningful in addition to lucrative. I'd like to think that I've produced something that makes other people's lives nicer and doesn't just transfer wealth from them to me. Finance doesn't give you that - you can go home with a fat paycheck, but that paycheck is your only legacy.
If you're into money, though, a hedge fund is definitely the place to be. The hours are reasonable, the work is challenging, and the compensation is out of this world. I just can't shake the feeling that my industry is somehow "dirty". (And I don't even work directly for the big funds...I work for a small software shop that supplies some of the smaller funds.)