If you look back on that time of low self-esteem and a crappy life I bet there was a myriad of other things causing it and games were just your drug of choice for 'dealing' with it. At least that's my experience. And IMO if your life avoidance drug is games instead of almost anything else (alcohol, marijuana, etc.) you're probably doing better than most in such a situation.
"It's all just pixels on a screen" isn't really an argument for me because my work life, much of my social life, and almost every other form of entertainment that isn't video games (including what I'm doing right now) is all just pixels on a screen as well. And playing games with friends that are across the country or a few hours away is absolutely the best way to be social with them possible. Hell even when I go on vacation I make damn sure I capture pixels on a screen to look at later.