I'd like to see the LSTM brain in the OpenAI 5 model [1] replaced by GPT3 to see if there is any improvement.

[1] https://neuro.cs.ut.ee/the-use-of-embeddings-in-openai-five/