I once used an LLM to generate some nix code to package a particular version of kustomize. It "worked", when I ran `kusomize version` in my shell, I got the version I asked for.

I later realized that it wasn't packaging the desired version of kustomize, but was instead patching the build with a misleading version tag such that it had the desired version string but was in fact still the wrong version.

It's useful to see how other people shot themselves in the foot.