After doing that, I find myself looking at my phone out of habit/boredeom, but realize I removed the last time wasting app (I got rid of reddit about a year ago) and turn the thing off again. This results in me doing things I consider to be a better investment of my time.
Yes, that might be watching a show on TV - but I found that to be more engaging than mindlessly scrolling through people's opinions I ultimately don't care about (as Twitter, as opposed to say HN, rarely spawns intriguing thoughts).
Also not having a simple distraction available does result in me being more likely to spend time on more "important" things, might it be yard work or a side project. But it certainly depends on one's personality and preference.