> GPT-4 boasts 100 trillion parameters
Source? I’ve never heard this.
I’ve heard 1 trillion and that it’s a 8 x 175B ensemble.
Source? I’ve never heard this.
I’ve heard 1 trillion and that it’s a 8 x 175B ensemble.
And I wrote the entire content myself.
Many of the linked references are too recent to be in the training corpus (Llama 2, for example), so unless there's some web-search component to this it looks like an LLM wrote the first draft, and a human went through to edit, add links, and populate with images, etc.