Has there been any official confirmation of the number of parameters used in gpt4? Pages around the web seem to have conflicting reports on the number, ranging from 1T to 170T, but there doesn't seem to be anything official.
Just to expand your lower bar, some people suspect it is not much bigger than GPT 3.5 @ 175B parameters, but this is also speculation. I don't think there has been anything official.
Given how PALM2 had less params than the first one (540B) I think that makes sense.
Can't be less though, the latency difference between them implies that GPT-4 is significantly larger. This is unlike with PaLM, where latency decreased.
That is correct. The open science made at OpenAI managed to publish a 100 page GPT4 technical report without using the word parameters one single time :-) ( I checked ).