I worried about that too, but jumped in and it hasn't been an issue at all in two years. Including three bank apps. And it's usually so easy to reset to vanilla Android if you need to that it shouldn't be your moat.
Things like Apple/Google Wallet aren’t significantly superior to a contactless credit/debit card.
About the only bank thing I can think of that actually requires an app is check deposit, which is super rare.