If you're waking up before sunrise, it's going to feel about the same no matter when sunrise is.

And you'll have sun at lunch time except in extreme cases.

So when days are short, mid-morning and afternoon are where the difference is really made. And I'd much rather have sunlight when I go home than have more mid-morning already-at-work/school sunlight.