A RL agent with a large Transformer seems to me like a design that would build an AGI.