You still need a trusted, personal device to use those apps.
What if you don't have a personal device at all, how do you check your e-mail at a library?
At a library, a staff member could create authenticator codes for people who often visit and are recognized by the staff. The visitor would then request to see the code if they need it. Of course this is a lot of effort for the library to identify people and the visitors must rely on their local library, they still can’t access their e-mail if they are on a device somewhere else.
Could you solve the identity problem with a real key, like for a safe deposit box, but unlocks a 2fa key?
If stolen, has little to no resale value and zero personal information on it, and you can unregister the key from online services