The main issue I run into with this is, if I neglect to charge it, and I go to use the computer and the mouse is dead. So then I need to plug it in for a bit, and can't use it until it is charged.
But that really hasn't happened to me much. In any event, a good reason to keep a wired mouse in hand too just in case.