Decoder only architecture? What is this? That doesn't sound like a transformer at all, are you saying gpt4 uses a totally different algorithm?
[1] Original Google Paper - https://arxiv.org/abs/1706.03762
[2] Original GPT Paper - https://s3-us-west-2.amazonaws.com/openai-assets/research-co...