Get a Fairphone or old Pixel and stick Calyxos on it :-)
My banking apps work fine, surprisingly. And some Google (Gmail, Phone, and Fi) apps too, surprisingly, but not all (eg Meet, Messages, and Fit)
I do have a local payment app, which would be nice to not lose, but it's not a hard requirement. The number of apps I use these days are surprisingly low.