Besides the privacy risks with full on moving your banking to Google, I think another big issue is when they decide this product isn't profitable any more, and/or some other department in Google comes up with banking 2.0 and you end up having to move all your bill payments, auto draft, etc back out.
If we thought killing Google Reader was bad, killing your bank app would be even worse.