I have gas stove, hot water, dryers and heating. The hot water and heating were upgraded to gas fairly recently, from oil (I live in New England, there are a lot of legacy heating systems- oil was actually an upgrade in the 1940s from the original coal heat). There is strong incentive to do this because oil was costing me $3800 / year back when oil hit $5 a gallon, whereas gas costs $700 / year. This upgrade costs $14000 (includeing installation of forced air vents, central A/C and gas water heat tank). The previous upgrade from coal to oil was about reducing waste and increasing convenience. With coal, you had to deal with ash waste and stoking.
A dual-stage electric heat pump would in theory work and have comparable operating cost, but the install cost was like $30000, had questionable reliability and few contractors even knew about it. Geothermal would also work, but my land is tiny and the cost would have been something like $60000. There was even a Honda generator home co-generation plant option available, but again, expensive and no contractors.
What would you do? BTW, my largest utility bill now is actually water, because we are paying for the Boston harbor clean-up in my sewage bill. I'm tempted to illegally use rain water for the toilets... A rooftop solar system is popular around here, but it's not worth it based on my tiny electric bill.
We have to get off of fossil fuels, but it's definitely going to take a government mandate backed with financial incentives to get people to switch.