The only point where I disagree is "the search engines have gotten a lot better over the last say 5-10 years". My impression is rather the opposite.
In parallel, the internet just changed, which means "the best result" may just be a worse one. In part because of search engines, and SEO. If you want a recipe, now the best recipe may just be the one that has a long description of the author's relationship with their mother who used to cook this dish, which you have to skip, because of SEO.