Nitpick: LLMs are not really programs though. You need something like <1KLOC to spin one up on your GPU, but most of the work is not done by C++ or Pascal or BASIC at all. Which might be important, or might not be.
That said... uh, put this way, there's a game called Stationeers, where you can run microcontrollers with an instruction documented as
"HCF: Halt and Catch Fire"
Sure, it's only a simulation of a simulation, so what's the worst that can possibly happen?
Right, all the other players in the session yelling at me "Kiiim! You burned down the base again, now we need to reload and redo the last hour!"And look, I get it. LLMs have vectors that could have been labeled things like idk... QZ12345 or HCF1111 . People chose to call 'em "frustration" or "pain" instead. THEY picked those names because they caused the LLM to act in particular ways.
You gonna say the actual vectors aren't there in VRAM, just because you don't like the naming scheme? There's papers on this, you can read them out in a debugger. What are you going to do about it?