Still, for heating, especially in really cold climates, a Heat Pump is going to have a hard time competing against other approaches, in efficiency, efficacy, and cost.
The latest gen of "ductless" or "mini split" units are awesome *AC* units (efficient, quiet), and I'd definitely recommend checking them out for cooling. If you're somewhere that it doesn't get too cold in the winter (lows in the mid-20s at the lowest), you might be able to tolerate using one for heating, but any colder and you're going to need another solution.