You should invest in thermal insulation.
When I turn off the heating for a weekend, and there is cold outside, the temperature inside only drops ~2-4°C during the whole weekend.
The house as insulated as it can be without costly work being done on it and trying to plug up every leak. It seems like you either have a small residence or state of the art design to only drop 3-4 degrees after an entire weekend, or that you also live in a warm place.