Carry a smartphone that you only use to do those things. Powered off all the way when not using it.

Almost everything in that list, is not actually an impossibility for you to get around using. The first half is basically conveniences you're used to having. Buy a bicycle! Print your gym ID or provide name/phone number (this has worked at every gym I've been to)! Tell your job you need them to provide hardware if they want you to use the app. If your apartment really only opens with an app, I'd see if you can clone the RFID and toss it on a keychain.

Everything is an option, it's a decision of convenience. More and more I am thinking it's not worth the convenience.