Yes, I've wanted this for years. I still use Mint but I hate the password part.

There was a clever hack someone posted here a while ago about using the email alerts feature to essentially get a read-only feed of transactions from a bank account. It does require you to parse the email and build your own system, so it wouldn't work for most people.