A heatpump is more energy efficient than most other forms of heating. A heatpump is not always the most efficient way to cool a house.
Both are active temperature control, and both are much more efficient than previous forms of heating and cooling.
There's also the fact that cooling uses much less energy than heating because the temperature differential is usually much less extreme. It takes less energy to go from 100F/37C > 75F/23C than it does to go from 32F/0C > 65F/18C.
I'm not saying people are always right when considering cooling a luxury while considering heating a necessity, but there is a historical reason for that mindset.
I think building design/thermal mass and population density/location has changed quite a bit over the centuries.