When most people were busy with startups in the early 2000's I knew a group of people who started a bank. Boring as it gets, lots of red tape, but once it got going it was profitable.
Fundamentally, banks are scale businesses (much like most technology companies). Expensive to start, but once you've got the product / regulatory infrastructure in place your marginal revenue is really low-cost.