This is only true in your country. Most people in the world do not have the luxury of affording this, and for many that do it's not worthwhile.
I live in Ontario, Canada. Almost all of my electricity comes from nuclear, hydroelectric and wind. Solar panels are not particularly efficient so far up north and they are covered in snow five months of the year anyway. Solar is mostly a waste of money here. (I still see the occasional house with solar panels but I mostly interpret it as a protest against nuclear power.)
Electric cars also don't fare particularly well in our winters. It's pretty hard to go visit family out of town when your car has half its stated range. I'm of the opinion that pervasive plug-in hybrid vehicles would do far more to reduce our collective carbon emissions and buy us time to get plug-in hybrids with renewable fuel (biodiesel, ethanol, hydrogen, etc.)
Heat pumps I agree would help. Unfortunately my country has huge amounts of cheap natural gas. Until carbon taxes start ramping up and heat pumps are subsidized I don't think most people will willingly increase their heating costs.