Not only that, but even when you get the LLM to give you the right answer, if you ask it to turn that answer into actual code committed to your repo, it usually destroys something else in the process.