Tensor accelerators are very recent thing, and GPU/WebGPU also recent. RAM was also limited, 4Gb was long time barrier.
So, model should run on CPU and within 4Gb or even 2Gb.
Oh, I forget one important thing - couple years old mobile CPUs was also weak (and btw exception was iphone/ipad).
But, if you have gaming mobile (or iphone), which at that time was comparable to Notebooks, may run something like Llama-2 quantized to 1.8Gb at about 2 tokens per second, not very impressive, but could work.
I think, Apple entered race for speed with iPhone X and iPad 3. For Androids things even worse, looks like median achieved Notebooks speed at about Qualcomm snapdragon 6xx.
LLMs will be (are?) a critical piece of infrastructure. Commoditizing that infrastructure ensures that firms like Google and Meta won't be dependent on any other (OpenAI) for access to that infrastructure.
Meta in particular has had this issue wrt Ads on iOS. And Google wrt paying Apple to be the default search engine.
See also: Joel Spoelsky's famous Strategy Letter V [0].
[0]: https://www.joelonsoftware.com/2002/06/12/strategy-letter-v/
Yes, idea, to make basically free something, on which small-medium businesses could survive and grow to something big, so making big death valley between small and big businesses.
Only exception are tiny businesses, living in tiny niches, but for them nearly impossible to overcome gap from tiny to big.
And you should understand, "open models" are in reality open-weight models, as they not disclose sources from which trained, so community cannot remake model from scratch.
Headhunting is sure important, but big business typically are so much finance powerful, so they could just buy talents.
- Headhunting with reputation is really important for small businesses, because they typically very limited in finances.
Medium business typically between small and big, but as I said at beginning, making some strategic things free, create death valley, so it become very hard to be medium.
Reputation is good thing for all, but again, top corporations are powerful non-proportional to size, so in many cases for them is relatively cheap to just maintain neutral reputation, they don't need to spend much to whitening.