> I'm not so confident this is really different from how a pro Go player would react 10 years ago to the analogous question.
Yes, and there were people in the 1960s who thought computers of the time were only a decade away from being smarter than humans. The question is one of category -- Go is something that a computer could conceivably be better than a human being at. There were certainly Go programs better than some human beings at that time. "Reading a human language document, communicating with stakeholders to understand the requirements in human language, understanding the business requirements of a large codebase, and writing human-readable code" is so categorically different than what Copilot does that, and something that no computer is currently capable of. If such a thing is even possible, we haven't even begun to tackle it.
> in 5 years will there be an AI that's better than 90% of unassisted working programmers at solving new leetcode-type coding interview questions posed in natural language?
I think that's highly unlikely, but it is within the bounds of possibility given what we know about AI currently (and probably, like GPT, it will only work under specific constraints). But the gap between that and what an engineer does on a daily basis is enormous.