Hacker News Reader

Comment by simonw | Hacker News Reader

Citation needed on "trivial to fine tune".

There is no citation needed. It is indeed trivial to fine-tune. Doing a good job is another matter, but the claim is correct. Google around and find a blog post showing how.

The claim that RAG is dead is obviously wrong.

For "citation needed", read "please link me to a blog post showing how, don't just tell me to Google for one".

The internet is full of blog posts about this. That doesn't mean they're actually good - I'd love to be pointed at one that has proven itself useful for someone (and definitely isn't just LLM blog-spam).

I don't care if it's trivial to fine-tune and get crap results - I care about fine-tuning where the result was worth the effort.

For the record, my favourite guide to fine-tuning is the section of this Jeremy Howard video that shows how to train a text-to-SQL model: https://www.youtube.com/watch?v=jkrNMKz9pWU&t=4850s

It's an internet forum, not an academic journal. Water tight arguments are not needed. If one wants to call bs, they can just do it, no need to dance around the topic by asking for a citation.

OK, I call BS. Fine-tuning an LLM is not "trivial" - especially if you want to get useful results, as opposed to just being able to say "look, I fine-tuned an LLM".

Yup, largely agree.

Exactly, it's a forum not Twitter/reddit. Without references and citations this is no better than a bunch of random words, and it's hard to make any argument of substance.

The person asked for citations, leave it be, stop dudexplaining how Internet works for you please.

I call bs on your 2 comments.

They didn't ask for citations. They pointed out a citation was needed. It was a clever sounding way of calling bs. They admit as much.

Even when people sincerely ask for a citation on a debatable topic, on an internet forum, it's effectively saying "I won't be hear any opinion that doesn't match my own unless it's as water tight as a law of physics". Another form of this is "show me the data".

Check out Google's AI Studio. It makes it easy to fine tune.

Disclaimer: I work for Google.

Reply on news.ycombinator.com