The US average cost of electricity is 16 cents / kwh [1]
The US average cost of Natural Gas is $10.84 / thousand cubic feet [2]
A thousand cubic feet of natural gas contains around 300 kwh of energy [3]
So natural gas is around 4 cents per kwh. Gas furnaces are extremely efficient, buts lets round up to 5 cents/kwh to be conservative.
So a heat pump needs to maintain a COP of 3 just to be in the same ballpark as natgas in terms of cost, and closer to a COP of 4 to be cheaper. Heat pumps "work" down to -20F or so, but the efficiency severely degrades. Heat pumps as a sole heat source are not cost competitive in cold climates.
I have a heat pump in New England, and it is wonderful for 3 seasons of the year. I think all new construction should have one. But the cost to heat during winter is ridiculous. I am very glad I had an auxiliary natgas heater put in.
[1] https://www.eia.gov/electricity/monthly/epm_table_grapher.ph...
[2] https://www.eia.gov/energyexplained/natural-gas/prices.php
[3] https://www.eia.gov/energyexplained/units-and-calculators/