Salesman have for a long time teaching new salesman to use NLP tricks like matching and mirroring to convince people you're relatable and trustworthy. Google is doing this with all the data they have on you.
Unfortunately I have seen far too many people, especially less tech savvy ones rely pretty heavily on the AI summaries provided by the search engines. And I think it can be a bit dangerous to have these results be super unreliable in what they state. The Google one also isn't perfect, but I've at least found it's a bit more accurate. However I personally don't really care for either. As I mentioned in my OP if I already made the choice to use a search engine, it's likely because I don't care for an AI response as I could open up Claude/ChatGPT or whatever's interface and ask the question there if I just wanted AI.
To turn off AI features of DDG, top right pancake icon -> settings -> AI features -> off