The content producer is incentivized to make content as quickly as possible in as little effort as possible and cover it with as many ads as possible.
On the other end, it's within GBYs interest to be slightly confused; by not nailing it, the user engages with the search using different words, potentially hitting an adword and clicking. GBY could be convincing the user that they're just using it wrong and need to execute more searches.
So the financial cost/reward model is configured in a way that gives high margin to spammy trash covered in irritating obstructive ads and search engines that are mysteriously confused by what we ask for. And that's the modern web.
Finally we are taught to tremble in fear if we dare consider touching the sacredness of The Market. So here we are stuck with trash technology to search avalanches of garbage.*
Luckily there appears to be a few search engines that focus on sites without advertising and trackers and they seem to produce nice results
---
* occasionally people like to claim this is just freedom or something so let me clear that field now: being forced to focus on maximizing profit isn't a free society. A free society would permit various missions to be pursued without fear of being squeezed out of existence by those focused exclusively on profit maximization. If priorities are imposed by a p&l tyranny, that's not freedom