Personally I feel like it's a dangerous precedent because it shifts open source from a community concept to something that a company lets you have with a bunch of conditions.
Personally I feel like it's a dangerous precedent because it shifts open source from a community concept to something that a company lets you have with a bunch of conditions.
Because you think that Protobuf, Android, Chromium, and all the other open source projects by Big Tech are there for the community? It's about control.
Not saying it's fundamentally bad, but you can't deny that the fact that Android exists means that it is very difficult to get adoption for an alternative "open" mobile OS, and Google benefits greatly from it. Same for Chromium, and basically everything.
When Big Tech open sources something, it's a strategic decision. Not philanthropy.
So from Google's perspective, not open sourcing Protobuf does not really give them an edge: alternatives exist. However, by open sourcing it, they end up with a ton of devs who learn Protobuf outside of Google. That makes it easier for Google technology to be adopted if they release something new, and when they hire a new engineer, it's a win if he already knows Protobuf.
Same applies to gRPC and others.
There are new models/papers/backends coming out all the time (including SDXL, which is similar to the original SD), but the community is so entrenched in Stable Diffusion 1.5 and the old Stability AI PyTorch implementation that moving to anything else hasn't really happened yet.
That being said, I think Llama won't stick around as the "de facto" standard for over a year unless Meta keeps releasing better foundational models.
It's not just inertia, the later models (even 1.5 over 1.4) are heavily censored. And at least in the case of 1.5 it appears to cause obviously inferior output even for content which is in no way explicit.
My understanding is the facebook published Llama 2 chat fine tunes are more or less the most censored LLM yet, refusing to even discuss negative sentiments. I bet we'll see other people's RLHF fine tunes on the base model being used as a point for more developent.
It's an unfortunate development that it appears that the primary commercial "value add" is building models that don't do what the users unambiguously direct them to do. It's hard to make a model smarter, but easier to lobotomize one.
1.5 is better than 1.4, but 2.0/2.1 are indeed heavily lobotomized.
The jury is still out on SDXL, but I think its much better. But the second thing I alluded to, the backend, is going to be more of an issue.
The chat finetunes of Llama 2 are kinda irrelevant because the community will come up with their own very uncensored finetunes.
Which they never apologized for!
It's not really a unique precedent, Chromium and Android fit the same model, but it's still very much better than closed-source (electron and custom Android ROMs are something you couldn't have otherwise).