Random aside: The author of this, Bob McGrew, is now the VP of Research at OpenAI.