I have no idea how you are so certain of that.
Meta is definitely ahead of Google in terms of NLP expertise and has been for a while. I suspect that Google released their best model at the time with Bard.
Meta is definitely ahead of Google in terms of NLP expertise and has been for a while. I suspect that Google released their best model at the time with Bard.
https://imagen.research.google/
https://google-research.github.io/seanet/soundstorm/examples...
https://google-research.github.io/seanet/musiclm/examples/
Why would it be surprising that they have better models for resarch that they don't want to give out yet?
The other things you are describing are just standard for research paper releases.
Yes I would agree with you if Google wasn't set on to full on panic mode by their investors about releasing something vs Open AI due to Chat GPT's buzz.
Bard was just a "hey we can do this too" thing, it was released half assed, had next to no marketing or hype.
Vertex AI is their real proper offering, and I want to see how PaLM 2 does in comparison.
Not going to keep replying, believe what you want about Google's capabilities
> Llama 2 70B results are on par or better than PaLM (540B) (Chowdhery et al., 2022) on almost all benchmarks. There is still a large gap in performance between Llama 2 70B and GPT-4 and PaLM-2-L.
https://scontent.fsyd7-1.fna.fbcdn.net/v/t39.2365-6/10000000...
If Google's publically available model is better Llama 2 already then why is it so inconceivable that they'd have private models that are better than their public ones which are better than LLama already.
Palm-2 isn't better than GPT-4 but the convo was about better than Llama models no?
You seem to be under the mistaken belief that: 1. Google has competent high-level organization that effectively sets and pursues long term goals. 2. There is some advantage to developing a highly capable LLM but not releasing it.
(2) could be the case if Google had built an extremely large model which was too expensive to deploy. Having been privy to what they had been working on up until mid-2022 and knowing how much work, compute and planning goes into extremely large models, this would very much surprise me.
Note: I did not have much visibility into what deepmind was up to. Maybe they had something.
Some among us work with it, or have friends or family who work with it. I imagine it is one of those.