Poorly insulated houses are windy with the windows closed because cold air drops. Air close to the windows gets cold (a single pane of glass doesn’t provide much insulation) and the cold air drops to the floor displacing the other air in the room, thereby creating a current. It’s like opening the fridge with bare feet. You can feel the cold air falling on your toes.