I think experiences vary depending on person and personality.
I'm fine with doing nothing for a long time[0], but know friends and family members that struggle with not filling idle time with their phone. I do think this is learned behavior that people can adjust over time with practice (i.e. meditation).
0: I'm a voracious reader, frequent solo traveler, and was a paid photographer for a bit. Sitting, observing, and thinking is something that I do on a daily basis and comes naturally to me.