Whether it may be possible to convince a bank to give you a hardware token instead if they even still make them is not an assured thing.
Where is this?
I have lots of bank accounts, probably more than most people. Three local credit unions, Fidelity, Schwab, Chase, BofA, Citibank, Barclays, two local area banks, and two international banks. Plus a few lesser known ones for 401k/IRA accounts.
I have never installed any bank phone app. I do all my bank interactions from my desktop via Firefox.
There can be alternatives in some cases (some banks offer code generating card readers, for example) but for personal accounts in particular, it would probably be difficult to operate without banking apps.
In Singapore, the largest local bank, and three large overseas banks (Citibank, HSBC and Standard Chartered) all require my to be near my phone to login. However, I haven't tried just saying I don't have a phone from the beginning. I know they used to have physical security tokens, perhaps they still would have provided one if I had insisted.
In New Zealand, I've only come across one bank that requires you to provide authentication from your phone (Rabobank), and in Australia I have less experience, but it's not universal either.