...why do I care about push notifications? By "customers love that feature" you mean, you like that feature. Most people aren't interested in having an app at all but the ones that are just want to be able to look at their balance, make payments, and cash cheques.
If I want to see if I have made a payment, I just open the app...which takes 10 seconds instead of a 5 second push notification.