Had to use my old TI 89 one day. Haven't used it in 10 years. Took it out of storage, put in 4 AAA usb-c rechargable batteries, worked like a charm. Could you do the same with your hard to replace custom battery?
Any consumer electronic using standard format batteries is superior by default. Because 10 or 20 years from now, it still have brand new full batteries lying around.