Which models are you using.
If you connect an LLM to pilot a plane with passengers, prepare the obituaries, because would happen sooner or latter, an undesired index got mixed and produced a mixed/wrong output. But here, the bigger mistake would be to let an LLM execute commands without human revision, aimed by the deceptive marketing around the A"I" (LLMs).