Hacker News Reader

Comment by simonw | Hacker News Reader

I'm still looking forward to a fine-tuning vendor publishing an interactive real-world example of one of their fine-tuned models, accompanied by the exact training data that was used to create it.

OpenAI's examples here are artificial, and there's no mechanism to try out the results: https://platform.openai.com/docs/guides/fine-tuning/fine-tun...

Fine-tuning is expensive in terms of both time and money (more so time these days, a lot of the vendors have free trials now). Before I put that work in I want to get a much better idea of the kind of results I can expect.

View on HN

Fine tuning always felt like something that only works at incredible scale with a lot of data.

Prompt engineering, RAG, etc. provide so much more uplift per unit time invested. Maybe fine tuning makes sense if you have a 9 figure budget and thousands of humans to throw at it. I don't feel this works in a typical startup ecosystem. I couldn't move the needle with the amount of data I had on hand.

To this point, guaranteeing that your fine-tuning doesn't actually weaken the hallucination-resistance of state-of-the-art base models, by overfitting to specific examples in your training set, is a really hard thing to measure. Unless you have robust ways of validating LLM output so that you can do real cross-validation, few-shot prompts, where you can instruct the LLM exactly how much you want it to generalize from those examples, may be far better at achieving many goals.

What about techniques like LoRA?

I thought these models were already leveraging this technique (or something approximating it) as part of their fine tuning offering.

perhaps my ignorance and my beginner level on the topic are biasing me, but in my experience, fine-tuning the GPT-3.5 turbo has elevated our operation to another level. When we put it into production, it became much faster, more accurate, and cheaper when compared to original gpt4. Our use case is to make unstructured data return a JSON with some key-value entities where the order matters.

Reply on news.ycombinator.com