Same is true of Google search “summaries” where quite often I click on the link provided and it doesn’t support the statement Google made.
BTW, this post would be more convincing if it wasn’t written in Claude voice itself!
BTW, this post would be more convincing if it wasn’t written in Claude voice itself!
You need cheap, fast inference to put on a search results page and finish near the deadline (~3 seconds). Cheap, fast inference is more likely to get stuff wrong. No one is happy.
My understanding of Google politics is that the small number of search team members who implemented any given 6-month-old feature will be happy as they will have been promoted away from the team and not responsible for maintenance nor quality.
Northern Belgium and the Netherlands have web content in the same language. But google uses the content in one lump. Problem is when you search for employment/fiscal/legal/… you constantly get content that applies to the wrong nationality.
It's not 2/3 correct, it's <1% correct, in my experience. Maybe it's because I check things that sound off more frequently, but even random checks have not panned out well.
Anybody relying on Google AI summaries is misinforming themselves.
When you point it out, it’ll do the “ohh you’re absolutely right!” bs. Marketing material and management that believes the material wants to pretend that AI agents are junior employees, but forget that junior employees get fired for doing something like this.
The search result showed a paragraph containing the searched word, the website did not