Simply install an air conditioner and you will have very efficient room heating (no hot water, though). They cost about 1500€ and are really easy to install. I know in Bulgaria many households have switched from oil heating to air conditioners.
It's a more difficult situation if the house lacks water circulation (heated floors/radiators).