A fundamental flaw leaves LLMs strikingly vulnerable to attack
technologyreview.com
technologyreview.com
It's a bit like saying "If you give someone unlimited access to the database they can run queries!"
The security doesn't come from how you train the LLM, it comes from how you guard the input and output tokens.