After going into the Apple store, they said that the battery was a "consumable part" and therefore not covered by the warranty. However, when I asked what the part number was and how I could order a replacement myself, they said that the batteries weren't serviceable and even they had to replace the keyboard unit as that contained the battery and it was all glued together.
I pointed out that they've therefore designed this product to fail after a few years as you can't order replacement batteries as a consumer, and they agreed to replace it for free.
They don't want to, but they could with a 5 minute YouTube video and probably $10 in parts (plus the cost of the new tire, or oil, or whatever). Doing so also does not void the warranty on your car (maybe not true for spark plugs? Tires and oil can certainly be changed)