Of course, if you're willing to persevere through all that, and have very good people and/or sales skills, then sure, you might be able to join the ultra elite who own their private jets and have an island in Thailand. You'll need some luck for that too, though.
I think the only people that will 'make it' in finance are those that are genuinely passionate enough to endure the horrible work conditions and lifestyle while possessing the people/sales skills to be successful. Remember, to make it to the top in finance firms, you need to bring in revenue. With the exclusion of trading, this generally involves sales skills. Same goes for management consulting and probably law as well.
I don't think there's a "too late", but there's a different skill set you need, especially to get a good job in finance.