So if you are cooling a house to 70 degrees in 90 degree weather, you are fighting a 20 degree difference.
If you are heating a house to 70 degrees in 30 degree weather, you are fighting a 40 degree difference.
In a severe heatwave, you might spend weeks with much of the day at 100 degrees; during a cold snap last winter, there was a span where I live where the temperature was usually around 0, and never higher than 10 degrees.
Meanwhile, a furnace works by directly converting energy to heat; for simplicity, let's assume a heater generates 1 unit of heat for 1 unit of energy (it's 100% efficient).
An air-conditioner, however, moves heat, moving heat from inside to outside. An air conditioner doesn't use 1 unit of energy to move 1 unit of heat; an air conditioner might move 3 units of heat using 1 unit of energy.
So putting the two together, it takes roughly 6 times as much energy to heat my house on the coldest days as it does to cool my house on the hottest days.
The full answer is a lot more complicated than that, because other things in houses are generating waste heat and you need to look at the deviations above and below your target temperature range over the full year and across many different places. Someone else has already posted a link to US energy usage showing that total energy spent on air conditioning is a fraction of that spent on heating, but from the above you should be able to get an intuitive feel for why that's so.