Starting the car takes a lot of power from the battery (the battery has to run the starter motor to crank the engine), so if you don't drive the car long enough to recharge the battery to at least where it was before the trip, you'll have less charge than you had before. If you repeat that cycle enough times, the battery will eventually die.