I am currently 24 and an exchange student in München, Germany. I will soon leave Bavaria and return to Sweden in order to finish up my masters. Been working on the side in a field I am interested in but I feel like I am so incompetent that I can hardly contribute anything useful. It is demoralizing.
I relate to your comment; I've read a lot of books, put thousands of hours into hacking on side projects, played an obscene amount of video games. But nothing, nothing, has come close to filling my heart as much as spending time with my children. As far as I'm concerned, my career is a means to an end. The goal is to achieve financial security so that I can spend as much time as possible with my kids.
I'm not saying to go have kids willy-nilly, but this is my perspective.
The position I'm in involves some basic coding, but it has the possibility for more involved work. I can understand the fulfillment you're speaking of, which is another reason I chose a different path. Life's a balance. There's no right answer to this, but I'm sure OP and ourselves will find our way.