> In 2012 we had Internet deployment of fully decentralised machine learning (SGD)

Peer-to-peer training of the next big LLM when? :)