Hacker News Reader

Search "mixture of experts" on Google, some unverified leaks say GPT4 is using it already.

Can you share where you read about these leaks?

It was all over hackernews. Just google "hacker news gpt4 mixture of experts".

George Hotz was the first to mention on Lex Fridman’s podcast, and there have been several others close to OpenAI who confirmed.