For some use cases, legal reasons such as proprietary/private data, copyright, terms of service, prevent the use of a 3rd-party API.
On the other hand, directly using an off-the-shelf model, even the best ones, may not meet your performance requirements.
That’s where fine-tuning an open LLM is necessary.