I don't feel depressed but I think you nailed it with " So is the perception that you aren't doing anything if you aren't doing something all of the time".
Every time since I started reading stuff about self improvement (2 years ago) that, everytime I touch on video games I feel bad about it and that I should be focusing on something else. It's a constant inner struggle that it's hard to win.