GPT-4 is the best coding model by far and you can’t fine tune it yet. Start with GPT-4 and RAG.

Fine tune is good for changing behavior. For example you could create a dataset that makes the model directly output fully formed projects. Using RAG alone would require a bunch of prompt engineering to get the same.