> The "Star Trek computer" interface that everyone wants can't function if it doesn't have a sense of the world and the person it's talking to.
This does not make sense to me. And actually, it sounds a lot like employee cool-aid. Not everyone wants such an interface and it's not given that you need to know anything about the person it's talking to. In fact, I want the AI that I interact with to be perfectly anonymous and give the same answers to everybody.
In fact, I think I would trust search more if it were totally anonymous. What I searched for last week may or may not impact my search this week, so don't go assuming it will. I want the "pure" results, not filtered by what some algorithm "thinks."
Example: a friend runs a car repair shop and sends me email to my gmail account. When I search for car repair shop, should the AI prioritize my friend's shop in the results? What if a car repair shop sent out spam that didn't get filtered out of my inbox yet? What if I gave my email to the shop a year ago when I entered a sweepstakes?
The more I think about it, the only reason I can see to gather personal info is to benefit Google by selling more expensive advertizing. If google provided "pure" search results without using any personalized info, that would be the best in all situations.