In my experience, heating and cooling is the bulk of residential energy use. If you live in an older home, make sure to get an energy audit from the utility company (usually free - maybe you just need some additional insulation.
Also, thermal curtains (aka, black-out curtains) can help if you have a lot of window surface area.