> There's not actually that many people in the world that can adequately fine-tune a large cutting-edge model
If you know how to run a Python script, you can fine-tune a LLama model:
If you know how to run a Python script, you can fine-tune a LLama model:
As an example, the startup-employed AI researchers I know had already PEFT'd llama2 within a day or two of the weights being out, determined that wasn't good enough for their needs, and began a deeper fine tuning effort. That's not something I can do, nor can most people, and it's a serious competitive advantage for those who can. It's a rather different interpretation of "can adequately fine-tune" than "can follow a tutorial".
When I think "AI startup", I think of the places where these people work. I don't think there's many of those people, and I think their presence is a big competitive advantage for their employers.