Question about models and weights. When an organization says they release the weights, how is that different from when an organization releases a model, say Whisper from OpenAI? In what way are the model releases different in these cases?
(LLaMa also released the weights for researchers and they leaked online, but the weights are not open-source.)
When a company releases a model including the weights, you can download their pre-trained weights and run inference with them, without having to train by yourself.
The weights are the fruition of training. They make the model actually useful.
- Model is the code
- Data is the text/images used for traing
- Weights are the training results
For example Lucene, models will be the java library, data is text data like wikipedia and weights are the lucene index. if you have all the 3 you can start searching right away, if you have model+data you have to generate the index which can take a lot of time, training/indexing take more than searching or using the model. if you have just he model you need to get your own data and run training on it