Keep the propane. Use it 5 days every year. You still have 95% of the reduction in CO2 and pollution that a heat pump brings, and reliable heat. Nobody is saying you have to be totally reliant on the heat pump. They don't even work the same way.
This is like refusing to get an air conditioner because you'll have to get rid of your heater. KEEP BOTH! You aren't even really replacing your heating, you're replacing your air conditioner, because a heat pump is an air conditioner. It just also happens to be incredibly good at keeping your home warm as well as cool.
Reliable electricity is hard, and we’ll need it more and more as we travel down our increasingly electric future.
The warm fuzzy feeling you get inside from knowing you're saving the planet should keep you warm enough. /s