Use AA batteries.
The obvious response is that the mouse should be thicker to accommodate those batteries, but that goes against Apple's entire ethos.
I always shake my fist in the air and curse "Eric Seifert's Mouse" semi-silently in frustration!
The constant need to have lithium ion is really terrible. Battery life is less of an issue when I can swap batteries quickly with common sizes.
I found having to always keep a supply of batteries at hand was more inconvenient than just plugging in the mouse once in a while.