My theory is that it's more about not-to-exceed ceilings [or the converse, floor] temperatures rather than average temperatures. When you have the huge temperature differential between the conditioned space and the outside, opening a door or something can affect the conditioned space's mean temperature by a huge amount for a short time. By over-conditioning or over-heating a space, you're more likely to be able to ensure the interior temperature never rises over ~75F, than if you'd set it at a comfortable 72F or so. Or in winter, it won't drop below a minimum comfortable temperature indoors when someone has to go outdoors.
Of course, once you've adapted to that habit, you may not always make seasonable adjustments to those settings.