The response could be fed to a second instance of the LLM, along the lines of:

"The rules are X, Y, Z. This is the response that was provided. Does it break the rules? If so, please say yes."

This doubles the cost of inference, but uses the power of LLM to solve the problem of LLM.