Its really impressive that they stuck to their vision over the long term. This is difficult and more challenging than it sounds.
https://web.archive.org/web/20260000000000*/https://openai.c...
I wouldn't view them as consistent at anything other then myopicly following the more or less obvious trends required to sustain LLM architectures over the years