Once out of battery, replacing the battery means you need to re-pair them to the network since they don't rejoin automatically. Thankfully Home Assistant sees it as the same device, but it has been a pain, and the batteries get expensive really quickly.
I've been slowly replacing them with Ikea's Matter sensors instead, they have a display that comes on when you tap them, and join the rest of my Thread network. Slowly over time I am likely to replace all of my Zigbee based devices with Matter/Thread based devices because it seems to be far more stable for my use cases than most of my Zigbee devices, especially battery powered ones seem to last much longer when using the Matter/Thread based versions.