If you watch his latest interviews you can see him talking about how he finds it useful for simple cases like in the Bloomberg terminal for generating code for queries, but it still has fundamental limitations for doing anything autonomously.

As someone who has used LLMs heavily at work and at home in various serious experiments, I agree. It still requires heavy babysitting and a lot of its limitations wrt context length are fundamental, not something that’s going to be easy to overcome.