I've yet to see a LLM asking any critical question, in order to understand the problem better. Without this, it can never be a good programmer because good programmers ask questions.
It's sort of immediately ridiculous that these LLMs could replace real people.