I’ll admit that this comment struck me as strange too (and the thought it might be generated also crossed my mind) but I try to keep an open mind and after considering it, I think the point about white supremacy is worth considering. Note that the writer didn’t say “you’re a racist” but rather framed it rather neutrally: “This can be seen as a form of white supremacy, as it can exclude voices and perspectives from people who may not have access”.

The question this raises is, who has access to state-of-the-art AI tech, and who does not, and might these groups have a racial dimension? Objectively, surely they do? Don’t lightweight models therefore serve an important democratizing purpose, in that they make this tech accessible to (for instance) people in developing nations who are overwhelmingly black and brown?

I'd suggest reading the recently leaked Google memo for some context about why open source LLMs are important (and are disruptive from the perspective of a large company). It gives a good insight into why closed source models like GPT-4 might be overtaken by open source even if they can't directly compete at the moment.

Typical reasons are highly specialised models that are cheap and fast to train, lack of censorship, lack of API and usage restrictions, lightweight variants and so on. The reason there's a lot of excitement right now is indeed how fast the space is moving.

https://www.semianalysis.com/p/google-we-have-no-moat-and-ne...