The model can look at X amount of input to decide what words come next.
Normally, Google fills part of X with instructions, and you control the other part.
However if you give it exactly X amount of input, then there's no room for Google's original instructions, and you control it all.
The "obvious" fix for this is to ensure that the their instructions are always within their horizon. But that has lots of failure modes as well.
To really fix this, you need to find a way to fully isolate instructions, input data, and output.
>No
Isn't the answer yes?
>The "obvious" fix for this is to ensure that the their instructions are always within their horizon.
That's what I take GP to be suggesting. Any possible failure mode that could result from doing this is less serious than allowing top-level instructions to be pushed out, surely?