Sure it's fine - I grew up in the age before the internet and still have the ability to daydream to pass the time. But I don't think it's necessarily superior to reading something interesting on Reddit.
I don't inherently disagree. However I do think that the quiet time provides a great space to reflect on things. But alas, I'm a hypocrite in this sense as I can't even walk my dog without feeling the urge to put on a podcast.
I honestly find podcasts to be excellent time wandery time, especially if they are of a panel format. Fade in and out of the conversation while you go for a walk.