Hacker News Reader

Where are you getting the 200 number from?

I must have hallucinated that. GPT-3 has 96 layers but they haven't disclosed the number of layers in GPT-4.

Interesting how we are already starting to use the lingo in the rest of our lives.