Is this doing anything more than using ChatGPT as a frontend? I thought based on your comment ChatGPT would run all of that, not just call an API that does the actual work.
The parent article isn't doing anything more than using ChatGPT as a frontend either. The API does all the _work_ (pipeline running, robot control, etc) while ChatGPT uses it's vast knowledge to interpret, analyze and iterate on future commands sent to the API.