According to their website, GPT-J is only comparable to the shrunk-down, 6B-parameter GPT-3.

gpt-neo is the one I would keep my eye on. https://github.com/EleutherAI/gpt-neo