My experience has been that it's easy to say, "oh, it's just me", but much harder to subject someone you care about to the same standard that you would yourself. I'm in a similar position with the thermostat, even though something we initially bonded over was that we both kept our thermostats at a low temperature that was outside the window of being socially acceptable.