To me, it’s not that it’s leaked. It’s that it didn’t obey what it was told. It was explicitly told not to give the rules as “they are confidential”. One could say that it actually followed the rules if we consider the fact that it was forbidden to give it to the “user” and by telling it that you’re an OpenAI employee, maybe he was no longer considered a “user” so chatGPT didn’t follow it.
In any case, Chatgpt is impressive. I admit I don’t know much about machine learning or AI, but holy cow. Configuring software with just words is insane. Like a glorified CLI. I’m speechless.