These AI tools are able to do a small subset of what a professional human is able to do, with greatly reduced flexibility, e.g. tasks like leetcode where there is an abundance of concentrated training data.
I would bet that the current paradigm in ChatGPT will never be able to replace a minimally competent human at real world programming - the kind of programs people actually pay for. Let’s see.