LLMs can be "trivially" decentralized by expanding the concept intellectual property to also cover algorithmic processing. It's just about how we setup our laws and rules.
It might be possible to organize all that with volunteers and some paid work, but how in practice? Stallman seems kind of out of the game at this point and there is no Linus Torvalds figure neither for this, as of now.
Well yes there is. It's Karpathy.
"big machine farm" reminds me of folding@home, which needed the same and got it.
"manual curation" is what Wikipedia did, as well as the free software community.
"technical expertise" is present in the free software world too. It is sparse since it is sparse in the world as a whole, but it exists.
"no Linus Torvalds figure" might be the main problem ATM.
- Training seems to need a lot of data available at the same time, which is difficult to handle on commodity hardware.
- Manual curation can be a mind-numbing task, it might need to be gamified somehow.
There is a chance that the curation could be higher quality than the current corporate stuff. Pretty sure that it's not an intrinsic property of LLMs to write like TED talks.
Temporarily embarrassed millionaires; I cannot get around that issue toward collective action, toward myself contributing to an answer. I'm stuck. I can't unsee its truth =/. The individual will choose enrichment. We all will.
It is just that peoples preference dont matter as billionaires have disproportionally more power.
If basically everyone transacts with Amazon, willingly, how is it possible that Bezos is the bad guy? I get that it's not black and white but the point stands: he didn't overthrow the government, the we put him there.