It's a 'simple' layer of banking, although they are not a bank. They're partnered with Bancorp. They offer some additional features (namely, direct deposit and FDIC backing) over Paypal.

I've been using Simple since September[0] as a complete replacement for my bank account. That's the idea - you replace your existing checking/savings/etc accounts with Simple.

[0]: I work there.