So now whatever the output, it still requires a human who knows about 'coding' or some other expertise to review the generated output of the AI and they cannot assume that the answer given by the AI is even correct.
This hype is going to subside into lots of garbage, once all the low hanging fruit is picked and people realise that the outputs of LLMs like ChatGPT is untrustworthy.
It wrote much worse code last year, and couldn't write passable code in 2021.
I dread reviewing someone else's code. I consider it the hardest part of my job as it requires a lot of concentration lest some bug creep in.
I am reminded of some Java codebases filled with unknown annotations whose annotation processors were in some library being imported. It was a nightmare trying to figure out what was happening and I dearly wanted to accost the engineer who wrote that mess. Unfortunately they had left the company.
We still have people who need to know how the silicon functions, we still need people to synthesize the silicon primitives into something that can interpret assembly. We need people to write the translation layer between high level code and assembly. We need people working on the API that interacts with all the various hardware.
How do you think AI/ML systems will be troubleshot without people who understand how they are made?
Software is the process of creating and synthesizing abstractions. If you define programming as a specialty primarily concerned about the language/science/math of abstraction it will never go away. The layer of abstraction will change, but the labour of abstraction will always be there.
Even if you believe that AI will surpass us and will be able to invent and realize complex systems, that creates an existential threat to biological life, that type of battle would be fought with programmers. Even if you think we could program safety measures, gamma rays pelt the earth flipping bits on computer systems across the planet. Microsoft can detect solar activity by the number of crash reports they get. What happens when the wrong bit gets flipped? What happens when the wrong machine gets too hot?
I think the question you're asking might be closer to "What do you think the graph of aggregate %time spent on domain specific business logic over time looks like?"
I don't think writing software will be fundamentally different in my life time, faster as we codify more abstractions, but not different.
Will there be as many jobs as there are now? No idea but my guess is even if there is a shrinking of the market, AI will not be anywhere near the top cause. It will be more mundane reasons like the market itself stabilizing/shrinking, commodification of software skills etc. Said another way, the world does not need 1 million distributed systems experts. With or without LLMs, the bubble will pop someday and a lot of them are going to be out of work.
His goal was to find out "can ChatGTP generate all of the code I need for this project."
https://www.youtube.com/watch?v=g5_Ts9SWbYs
.
.
.
.
.
.
.
Spoilers: In the end he still had to make some minor modifications to the code by hand, but it came very close to generating the exact code he needed, although he did need a couple of rounds of going "back and forth" with ChatGPT to get it that close. Still, it was a moderately impressive demonstration of what ChatGPT can do today from a coding perspective.
I started to integrate ChatGPT and Codex into my workflow and I was surprised how useful their recommendations were for non trivial problems. Yes it required minor tweaks but if you know what you are doing it’s a huge productivity boost.
If it keeps improving at this rate I believe there is gonna be a point where actual coding stops being necessary.
IC advancement ladder looks like that already. LLMs remove the justification for low effort, low quality developers, because they can simulate that and far better.
When the internet became widely available you had a good long while where many people refused to use it because it was different from what they were used to. LLM's are already on the same arc, and you can already get internet like gains out of using them today.
Even after that I suspect a little code will be written by hand. The equivalent of writing assembly or C today. With how fast the LLM tech is moving though that may be naive.
Probably 50 years from now.