Hacker News Reader

Comment by glanzwulf | Hacker News Reader

> It messes up sometimes

i have the opposite experience as i've found it to mess up a lot to the point that I can't trust the AI Overview answer at all. I've seen it be confidently wrong too many times and now the trust factor just isn't there.

View on HN

Never ever trust AI summary cooking instructions. Holy crap.

I made a serious error with that once.

Did you add glue to a pizza?

I was searching for reverse sear info and it told me to make sure the steak is at least 37f/3c internally before eating lol

To be fair, being a solid block of ice would impair eatability

(I agree that AI result summaries would be quite handy, if Google's results weren't also so frequently incorrect at a basic or numeric level)

I’ve found video game tips to also be very incorrect hallucinations as well.

I often use LLMs to suggest recipes based on some criterias, but yes once you decided what you want to cook always go find some non-IA recipes for it

For simple queries it’s fine. The main value it adds is that it’s above the ad spam.

But it was trained on ad spam wasn't it?

And consistently quotes information from them, yes. They quite like showing reddit and news icons while searching, but expand the references and it paints a rather different picture, especially for common searches which are flooded with junk. Niche stuff seems more likely to reference decent sites, but have massively worse hallucinations.

I've found that the AI overview is usually right but confidently wrong enough of the time that I don't trust it. The interface that you get with the 'AI Mode' button (which I assume is just Gemini with very low compute settings), however, is usually pretty solid for well-documented queries.

Reply on news.ycombinator.com