> Isn't that the point of searching: find a specific thing in a whole bag of other things?
Web search isn't as simple as you make out to be. It's not a 'select * from blah where field like %like%'. Searching is about finding relevant information. Keywords are taken into account, but again, it's not a giant hashtable.
If I search for 'python file system watch', it shows me results for 'monitor' as well. Most of the cases, the keywords are the means to find the end result.
When you enter the queryterms, they pass through a lot of filters - removal of stopwords, n-gram tagging, spell check, hyponyms/hypernyms translations, lemmatization...before hitting the index. And then the ranking itself is quite complex.
And it's simply that sometimes 1 or 2 out of n query terms doesn't make it to the first page.
I don't work for Google and I don't know about how Google does it, but the notion that Google is ORing query terms is absurd. It just can't be. If Google were ORing query terms, you would never find MIT if you searched for "massachusetts institute of technology" or vice-versa.
> If you were right, Google would have done this from the start; why are they doing it now?
Once again, they aren't ORing query terms. The missing terms are falling out of the front page due to low rank.
> I don't use Google to find the Yahoo homepage (I know many people actually do; should we help them???)
Nothing special needs to be done for them. The generic ranking works great.
> If you were right, Altavista would have prevailed and Google would not have emerged; the way Altavista worked was, they linked the words in a query with the "OR" operator, so that any query produced at least some results, however irrelevant.
Google prevailed because of better ranking algorithm.
> (Could it be because focus groups are taking over?)
Focus group doesn't decide how algorithmic search works.