Yeah, I've had similar experiences to yours, nordic ski racing on a team all throughout college. We'd all get coughs the first few cold days, but that was it. We would avoid doing interval workouts if it was below 0° F though.