Yeah, you don't want to set the thermostat too low to protect the outdoor faucets (not all of them are freeze-proof, especially in the places where temps below freezing are uncommon). I also don't want to wait for 2hrs in the morning for the house to reach comfortable temperature, and would like to be able to go to the bathroom in the night w/o it being too cold.
Edit: is it more common to use forced-air heating where you live? Are buildings brick/concrete? Heating vía radiators w/ warm water and concrete buildings tend to have more inertia in my experience, the temp will not drop down that much overnight, but that's not the case in my current home.