This is why parents are always shouting at their kids to dress warmly, but I remember always being hot in my clothes as a kid and needing to take them off.
All I remember as a kid is being unusually warm in almost any cold conditions. Even now the cold doesn't bother me much, certainly less than my peers.
I'm sure metabolism isn't everything there, but it probably helps.