>It can't distinguish between your instructions and the data you provide it.
Which is exactly why it is blowing my mind that anyone would connect user-generated data to their LLM that also touches their production databases.
Which is exactly why it is blowing my mind that anyone would connect user-generated data to their LLM that also touches their production databases.
So many product managers are demanding this of their engineers right now. Across most industries and geographies.
It really can't even distinguish between your instructions and the text that it itself generates.