I had a large house that was heated by electric and wood and replaced them with a ground source heat pump with a loop zigzagging under my lawn. Relatively expensive to install but paid for itself in 5 years.

YMMV. Good luck, hope it works out for you too :)