Sometimes, rules and regulations actually do improve things :)
One of the most unnerving drives I had to do was traveling on the Ohio Turnpike in super-dense fog. The traffic was heavy but moving more or less at speed. Cue the toll plaza... and the need to reform two lanes of traffic, with slowly accelerating truck traffic, cars whizzing from the right to pass the accelerating trucks, all in dense fog with almost no visibility (I don't think you could see the rightmost toll lane from the leftmost). And one idiot didn't have his lights on.
Final safety tip: if you can't see the road very well, turn your lights on. Even if they don't help you see the road (which they don't in fog), they absolutely help everybody else see you.
A combination of wanting to get to your destination on time, inexperience and overconfidence are probably the key reasons.
Turned my lights on to avoid being hit, seemed to work - or maybe I was just surrounded by cautious drivers that day.