I've had panic attacks during loosely-structured periods in my life where sitting in the shower after waking up in the morning and having to decide what to do with that day was absolutely overwhelming. Sometimes when you have a lot going on and you're under a lot of stress there's a lot of pressure associated with deciding how best to allocate your time.
In contrast, I find a relative peace at 3am, since it's merely a continuation of what I had been doing earlier that day. I'm in a groove, and there's no major decisions to make regarding my resource allocation.
Waking up is absolutely one of my least favorite parts of the day. It comes with a tremendous burden, especially when living alone and not having a fixed schedule or a boss.