I would change banks. I have no issues getting 2fa with my bank or other entity I do actual business with on my Google voice account. Additionally any good bank would provide other methods. I do travel quite a bit and we'll get transaction confirmations from my bank they will text me for a confirmation they will phone call or I can use their app to confirm it. Any bank that only offers you one method to confirm a transaction and that method is a text message, your money is not safe there and they're not treating it like your money.
There are security implications to using 2fa on any text message service, but Google is one if the more proactive in detection of suspicious logins. If someone hijacked your number at the carrier you'll never know. If someone logs in to your Google account, Google will send you a message though several means asking if it was you.
The only places I've had trouble with a voip number are dating apps which I find laughable. They use the excuse it cuts down on spam and bots but considering how littered every dating app is with Spam and bots and prostitutes it seems to not be doing its job. I guess considering dating apps are not about pairing people together but about extorting money for premium subscriptions they could care less about the bots or prostitutes.