Yes, this is the secret sauce and the moat. Not as easy as buying more compute with unlimited budget.
… built on the back of a disposable workforce…
There is something grim and dystopian, thinking about the countless small hands feeding the machine.
… built on the back of a disposable workforce…
There is something grim and dystopian, thinking about the countless small hands feeding the machine.
Dystopian indeed, this is pretty much how Manhattan Project and CERN were done, with many independent contractors doing different parts, and only a few has the overview. A page out of corporate management book, it very much allows concentration of power in the hands of a few.
https://twitter.com/emollick/status/1786213463456448900
$22 in 2008 -> $33 today https://data.bls.gov/cgi-bin/cpicalc.pl?cost1=22&year1=20080...
Comparing LLMs to the Manhattan Project based on budget alone is stupid and arrogant. The comparison only "makes itself" because Ethan Mollick is a childish and unscientific person.
Just want to clarify. The comparison to Manhattan Project or CERN is referencing "the countless small hands feeding the machine." In projects such as these, roles and jobs are divided into small parts, that people who are working on it don't really see the forest from the tree, and that only a few that has the picture of the whole project.
I am wondering if "CERN was pushed on the masses by the few" is an oblique reference to public fears that the LHC would destroy the world.