I believe the fact that it is night time does a lot to it, since we're just wired for a healthy fear of the dark. Coupled with consciousness fading into sleep, it seems to open up a lot of dread.