GPT3.5 was 175B parameters and GPT4 is larger (nobody knows how larger) and it blows GPT3.5 out of the water.
So, GPT4 is, well, way more than 100B+.
And yes, I share your opinion
So, GPT4 is, well, way more than 100B+.
And yes, I share your opinion
Most of the valuable data in the world is private data unsuitable to send to GPT4 and other proprietary models.
How? Is there not extreme correlation between "13B parameters (low/not a lot) most likely means lots of hallucinations"
13B x10 might be the only feasible business model for your company, but that alone doesn't make it a superior option. Can you share more details on how the models work together?
Sam has said multiple times "the age of large models is over" https://www.wired.com/story/openai-ceo-sam-altman-the-age-of...
Either way, the LLaMa models are quite powerful and now that we have an open, commercially usable version in 3, 7, and 13b sizes is huge. The 65b model I'm assuming is coming soon as well.
I tried using some of these 13b models and was completely underwhelmed when compared gpt4.