Releasing the weights for a 1T+ parameter model doesn't really help "the little guy" when it costs ~$50K per H200 and 8 of them aren't enough to run a single node.
Somehow this plan manages to lean into every single bad outcome
Somehow this plan manages to lean into every single bad outcome
(That being said, Chinese labs are releasing weights, so I'm not sure how the economics actually work.)
It also takes a lot to do anything with a 1T+ parameter model. Arguably there is still an immense capital moat. So I'm not sure it would even have the effect the author intends.
That said, these frontier models are still astronomically huge.