I'd be interested to find out how many of these bloated batteries still have any charge. Internal discharge feels like a pretty nice accidental safety feature, albeit at the price of also killing a lot of old devices.
But yeah, preemptively removing batteries for safety is a good move.