Great follow-up work from OpenAI on this:

https://openai.com/index/emergent-misalignment/