Hacker News Reader

let's say that they ask a single question for each session they get. they are immediately doubling the compute they need in processing and then post-processing the same session twice.

nothing trivial about it. not saying they cannot feed "their own LLM" saying it isn't trivial especially at scale.

if you do not trust me try it without the "at scale" part.

View on HN

It's trivial and a solved issue for the companies developing frontier AI models. Obviously, you don't even need AI for searching every prompt every user has ever written to find interesting topics, but you can create automated summaries and use AI on them if you want. There is no "scaling issue" here for companies who are used to processing almost everything that has ever been written anyway.

I didn't want to insinuate that it's trivial for small companies or individuals to do big data mining at that scale, sorry if I made that impression.

I not only think it is not trivial, I know it is not solved.

I don't trust your judgment, it's in my opinion even hilarious given that we're talking about companies worth almost a trillion dollar (4 trillion in the case of Google). Be that as it may, it was nice chatting with you!

I also find it hilarious. I wonder what will happen if they don't solve this.

Reply on news.ycombinator.com