I've never worked for a start-up in a development role before, but I think I would like it. I am 28, fresh out of grad school and working for a bank currently. I like my coworkers and the work but when I walk by management and I overhear "We're not a development shop," I get disheartened because banks are becoming data centers and have to be in the software game.
Take a look at...
Dwolla: they are out to destroy the Automated Clearing House industry. Bitcoin: banks need to know how to interface with that! Micropayments: same deal. Mobile: OCR for check deposits! Data science/analytics ("big data"): obvious.
Banks that fail to adopt a hacker culture because IT is a "cost center" (despite the fact that all operational units of any business are) will crumble.