Did we ever get an explanation as to how Gemini Pro had such a large increase in rating so suddenly?
And is there an explanation as to why people will get a correct answer from this API but Bard will give you hallucinated, incorrect answers?
I think it's very important for Google to be competitive here so my hopes are high, but the Gemini launch been kind of an inconsistent mess.
Different fine-tune and gave it access to the Internet.
Source: https://x.com/asadovsky/status/1750983142041911412?s=20
It is doing well because it is a decent model and it also has internet access.
Safety bullshit on the app because that’s consumer space
Easy, they bought it.
2) this fails basic sniff test of how research is done. google overmarkets but it doesn't lie.
to answer GP's question - the #2 rated bard is an "online" llm, presumably people are rating more recent knowledge more favorably. its sad that pplx-api as the only other "online llm" does not do better, but people are recognizing it is unfair to compare "online LLMs" with not-online https://twitter.com/lmsysorg/status/1752126690476863684