It's not even really about choosing not to, either... it really does feel fundamentally like I cannot even derive a dopamine response to video games at all anymore, period. Same could probably be said about doom scrolling social media or whatever else. I just get no false positive feedback loop from the act.
I suppose if you just play the same game day in and day out and it has no real substance (which admittedly is probably the largest gaming segment) it might be a good thing to get rid of the habit. But some games are masterpieces and they often hit very different than other mediums because you are the protagonist making choices. In my opinion some of the best stories come in the form of games and I find it a real shame there's a portion of the population who think they're a complete waste of time.
I think there's also something to be said here about being addicted to work. I know such people and it's just as sad even if it's what society expects of them.
It depends on degrees. If you're going to lose your job and your wife is about to leave you stop doing it. If you just did 12 hours of work/chores/put the kids to bed and want to relax with a bit of gaming? Some people would still feel guilty but I haven't a clue why.
If you look back on that time of low self-esteem and a crappy life I bet there was a myriad of other things causing it and games were just your drug of choice for 'dealing' with it. At least that's my experience. And IMO if your life avoidance drug is games instead of almost anything else (alcohol, marijuana, etc.) you're probably doing better than most in such a situation.
"It's all just pixels on a screen" isn't really an argument for me because my work life, much of my social life, and almost every other form of entertainment that isn't video games (including what I'm doing right now) is all just pixels on a screen as well. And playing games with friends that are across the country or a few hours away is absolutely the best way to be social with them possible. Hell even when I go on vacation I make damn sure I capture pixels on a screen to look at later.