> I think that AI will rapidly slot into this niche of “indirect programming” however. As soon as token sizes allow large codebases to be be parsed and modified, it’s all over.
Context size is the least of an issue - current models suck in capability.
I've been building stuff on top of openai API for months and getting it to do trivial stuff with instructions reliabily is incredibly hard. These are things like "if a user asks a question about an individual but only specifies first name ask for last name before invoking a search function" - even with examples of what to do you'll get GPT 4 ignoring instructions and calling search with just a first name.
Like I understand that the potential they are showcasing is a breakthrough, and people are right to be excited about that - but we are extrapolating way to much based on breakthrough improvement pace.
We've seen similar claims about self driving cars being a year away since 2016.
Unless there's some breakthrough, I don't see AI affecting developer demand in the next two years at least.