I recently moved and only communicated with the real estate agent and the moving company by chat. Large trash reservation is online. Drivers license requires an application, but isn't that normal? Same with a lease; I think those are still paper in most countries.
I don't know of any ATMs that close anymore; maybe super rural banks still do?
It depends on the municipality, but the good ones have moved most of their paperwork online and allow you to digitally sign it with an actual signing certificate embedded on your My Number card and the NFC chip in your phone. If you're doing the paperwork on a computer, you scan the a QR code to complete only verification and signing with the phone.
Certainly not everything's cutting edge, but a lot of things are quite streamlined these days. Immigration paperwork, for example, is a cakewalk compared to the US, probably requiring about 100 times fewer pages at least in my past experience.
Edit: And as someone mentioned below, modern apartments are very soundproof, just not the old wooden ones.