for the Cola Cola drinkers, the product goes from an infallible AI to with no ulterior motives to another Google that’s purpose is to sell you ads, but more creepily. it’s like if Coca Cola started adding a few milliliters of bleach to their product
"how did X know whose profile you saw on Y service"
"the computer knows everything i do on the computer, what do you mean"
The more direct connection on something they don’t (yet) value as much as they value their phones might be a bridge too far.
An LLM feels like a person to a lot of people. It might be surprisingly difficult to avoid people feeling betrayed or creeped out by this “person”. No one has ever done this before and it doesn’t seem easy or like a straightforward win.
It is odd how often I hear even technically people defend the idea that Instagram is listening to everything they say even while the phone is locked, sending it to Meta, and then influencing their ad delivery. You have to either have very little understanding of mobile apps and reverse engineering to believe that this is happening but nobody has been able to find proof yet.
It’s right up there with people who believe conspiracies about everyday things like chemtrails. If you really though chemtrails were disbursing toxic mind control chemicals (or whatever they’re supposed to be this week) then you’d be going to great lengths to breathe only purified air and relocate to another location with fewer flight paths. Yet the chemtrail conspiracy theorists don’t change their behavior. They just like complaining and being angry, and it’s something they can bond with other angry complainers about.