1,016 karma · joined July 3, 2013
The reason I see it as a strawman is because the weights are the source of the AI model and they do allow you to modify the model however you please.
The data is not owned by Meta, they can’t release it and it’s not required to use or modify the model. This is like wanting a team to release the research that informed product development with their source.
The data and training code are not the same as the AI model itself. This is not the same as code that produces a binary, this is more like code that produces another form of code.
If you try to replicate the model you won’t be able to because the process is not deterministic. There’s no reason to replicate the model, you would fine tune it instead.
The weights aren’t binary. It’s not a compile form, it’s the actual source of the AI model.
The same code used to train the model / generate the weights will not produce the same model weights if run again, it is not deterministic.
Also you will need millions of dollars to retrain, retraining is not the goal. The model weights are the source that was opened. The weights can be used to modify the model.
You demonstrably don’t understand what it means to open source an AI model. The code is not relevant at all, the same code will not produce the same model weights, it is not deterministic.
Also you will need millions of dollars to retrain, retraining is not the goal. The model weights are the source that was opened.
To use something like Meta’s open sourced LLAMA2 model you don’t need the data. The model is self contained. It’s a compressed lossy form of all the data it was trained on.
The weights allow you to continue its training with new data of your choosing.
This is a straw man argument as Meta has released the model weights and not just the trained model. When it comes to models the weights are the source.
Some of these open source models can even be run on your local machine. It’d be very inexpensive to run thousands of pages through it.
Keep in mind paper was published before ChatGPT was released
I'm a milllenial that learned how to code at 14 using the internet. To be fair to your point about "free" I did use pirated software and a few pirated video courses