I would posit as a counterpoint that improving compilers, programming languages, and programming editors feeds back into improving the open-source tools available to tackle the problems of others. Hopefully, we eventually arrive at a series of summits where creating a useful solution for a non-technical problem using an open-source tools requires less and less obtuse, finicky, technical knowledge gained through trial-and-error.
That being said, I agree with you. Anecdotally, I haven't contributed anything to non-technical open-source projects outside of the odd bug report. That may be a good belated New Year's resolution.
I'm also hoping that interesting experiments in lowering the unnecessary barriers to doing powerful things in programming will inspire folks like me to find a useful way to contribute to one of those summits. We need infinite Alan Kays and Bret Victors.