> I've seen a lot of comments on here like "well LLMs are good at writing snippets, but could never write or maintain large codebases to accomplish a larger goal" - but are you SURE about that 'never' given the current generation is already doing things people suspected they could never do? "But they'll never be able to manage / interpret stakeholders", Are you SURE that LLMs will have to adapt to fit stakeholders, and not the other way round?
That sounds a lot like the self driving cheerleaders five or ten years ago. That work so far has resulted in some awesome features like adaptive cruise control and parking assist but it fell far short of what the hype was promising to deliver by now.
Five or ten years later Mercedes is the only company getting ready to ship level three self driving. Level four and five are still a pipe dream, practically restricted to a few companies like Waymo in a few controlled environments like Phoenix and San Francisco.
GPT4 is great and I can't wait to see what 32K or even 100K/1M token models can do, but I fear we're about to hit the point where progress grinds to a halt because going further requires something closer to AGI than what we have now.