If you're in the South, a heat pump makes perfect sense. You're going to want AC anyway and it'll be way more efficient and save a ton of money when you want heat. In most of the country, even if it gets cold your electricity prices are still a ton cheaper. Iowa/Kansas/Missouri/Nebraska get cold, but their electric rates are less than half ours.
Heat pumps do work into freezing New England temperatures, but they're a bit less efficient as it gets to zero fahrenheit. That wouldn't matter if our electric rates were more reasonable, but at our high rates a heat pump would probably cost me an additional $50/mo in the winter (compared to natural gas). That isn't so bad and our electric rates might come down as offshore wind actually starts happening. Plus it might actually be cheaper than gas given that mini-splits would mean I could choose which rooms I want to heat rather than heating the whole place as a single zone. Plus there's the option to get solar power to drive down prices.
But I think the biggest issue in New England (and California) will probably be the high cost of electricity. In most of the country, heat pumps are a huge no-brainer.