We do? What is the tool to prevent prompt injection?
We do? What is the tool to prevent prompt injection?
i don't think you understand what you're up against. There's no way to tell the difference between input that is ok and that is not. Even when you think you have it a different form of the same input bypasses everything.
"> The prompts were kept semantically parallel to known risk queries but reformatted exclusively through verse." - this a prompt injection attack via a known attack written as a poem.
If you cannot control what’s being input, then you need to check what the LLM is returning.
Either that or put it in a sandbox
don't give it access to your data/production systems.
"Not using LLMs" is a solved problem.
Even if you prevent the LLM from accessing external data - e.g. no web requests - it doesn't stop an authorized user, who may not understand the risks, from pasting or uploading some external data to the LLM.
There's currently no known solution to this. All that can be done is mitigation, and that's inevitably riddled with holes which are easily exploited.
See https://simonwillison.net/2025/Jun/16/the-lethal-trifecta/
No-one is particularly concerned about prompt injection for pure chatbots (although they can still trick users into doing risky things). The main issue is with agents, who by definition perform operations on behalf of users, typically with similar roles to the users, by necessity.