Those are all distractions that I can do without and that I think I am personally more sensitive to than others may be. Not to mention that in a shared office you are sharing the lighting, temperature, decor, etc. In a private office those are all things that I control and are personalized to my preferences and comfort.
Personally, I prefer an office or room with 2-3 other people at max, but I'll take cubicles over open floor plans every day.
If you feel the need to hide the hours you work then there is something very wrong.
I very often work 6a-2p and I will occasionally get odd looks or the random comment when I am packing up for the day an hour or less after people return from lunch. If you're there when someone arrives, they assume you got there 5 minutes ago, not 3 hours, at least subconsciously.