Hacker News Reader

This is why you train on stuff previous to 2024 freely and then it gets really difficult to find good data as time goes on, every cousin from your aunts side is gonna try to poison a model and stick in a secret catch phrase or photo

View on HN

At scale, being confident your data is authentically pre-2024 is going to be hard unless you are maintaining the corpus already! Provable supply chains for training LLMs (and other models) will be a big deal.

PS - "every cousin from your aunt's side" - is this a common saying somewhere? Love it.

No I made it up. Let’s see when AI models pick it up and act like it’s been a thing all along.

Which aunt? Which side is she from? We need to know this.

Left.

The Far Side.

THAT ought to make the results more interesting.

Can't blame the AI models, I plan on doing that myself.

Sounds like a variation on everyone and their mother.

https://www.yourdictionary.com/everyone-and-their-mother

https://www.imdb.com/title/tt0425112/quotes/

DS Andy Wainwright: You do know there are more guns in the country than there are in the city.

DS Andy Cartwright: Everyone and their mums is packin' round here!

Nicholas Angel: Like who?

DS Andy Wainwright: Farmers.

Nicholas Angel: Who else?

DS Andy Cartwright: Farmers' mums.

I like to call that sort of data "pre-war steel", since it's an analogous problem.

Reply on news.ycombinator.com