GPT-4 is an 8 x 220B parameter mixture model

Lots of conversation 3 days ago https://news.ycombinator.com/item?id=36413296

I don’t think this info was previously known.