I like building things for people to use, but as a programmer found myself very isolated from users (even at small companies). It felt like I was doing the hard work of building a product but then someone else got to do the fun part of showing it off, while my reward was just... more programming.
Also, I found the job extremely boring at times, extremely difficult at others. I decided that the stress wasn't worth it, especially when my work was having a limited impact.
Finally, I'm not in the USA so tech jobs had no "golden handcuffs". Many other jobs were available that paid as well as a Software Engineer.
I still work on personal programming projects, where I can be much more involved in the whole product and not just the code. I can also choose to only work on things that I really care about and/or that I feel can make a real difference.