For the rest of us, the idea of a robot spending money on our behalf is kinda terrifying.
Yes. Having been in the room for some of these demos and pitches, this is absolutely where it's coming from. More accurately though, it's wealthy people (i.e., tech workers) coming up with use cases that get mega-wealthy people (i.e., tech execs) excited about it.
So you have the myopia that's already present in being a wealthy person in the SFBA (which is an even narrower myopia than being a wealthy American generally), and matmul that with the myopia of being a mega-wealthy individual living in the SFBA.
It reminds me of the classic Twitter post: https://x.com/Merman_Melville/status/1088527693757349888?lan...
I honestly see this as a major problem with our industry. Sure, this has always been true to some extent - but the level of wealth in the Bay Area has gotten so out-of-hand that on a basic level the mission of "can we produce products that the world at large needs and wants" is compromised, and increasingly severely so.
It's like the endless examples around finding restaurants and making reservations, seemingly as common a problem in AI demos as stain removal is in daytime TV ads. But it's a problem that even Toast, which makes restaurant software, says most people just don't regularly have (https://pos.toasttab.com/blog/data/restaurant-wait-times-and...).
Most people either never make restaurant reservations, or do so infrequently for special occasions, in which case they probably already know where they want to go and how to book it.
And even if they don't know, they likely either live in a small place, in which case there's not going to be a huge amount of choice, or a big place, in which case there will be actual guides written by people whose actual job it is to review restaurants. It really seems like a solution in desperate need of a problem.
But I think you're underestimating this use case, as the data you linked shows that Google is the top referral used by people to find the restaurant/booking website, and once SEO is overtaken by ChatGPT-like experiences it would make sense that "book this for me" would be a one-click (or one-word) logical next step that Google never had.
The amount of time that goes into "what food do we need for this week" is really high. An AI tool that connected "food I have" with "food that I want" would be huge.
For example, subscription purchases could be a great thing if they were at a predictable trustable price, or paused/canceled themselves if the price has gone up. But look at the way Amazon has implemented them: you can buy it once at the competitive price, but then there is a good chance the listing will have been jacked up after a few months goes by. This is obviously set up to benefit Amazon at the expense of the user. And then Amazon leans into the dynamic even harder by constantly playing games with their prices.
Working in the interest of the user would mean the repeating purchase was made by software that compared prices across many stores, analyzed all the quantity break / sale games, and then purchased the best option. That is obviously a pipe dream, even with the talk of "agentic" "AI". Not because of any technical reason, but because it is in the stores' interest to computationally disenfranchise us by making us use their proprietary (web)apps - instead of an effortless comparison across 12 different vendors, we're left spending lots of valuable human effort on a mere few and consider that enough diligence.
So yes, there is no doubt the quiet part is that these "agents" will mostly not be representing the user, but rather representing the retailers to drive more sales. Especially non-diligent high-margin sales.
Good news, usually by the time you reach this point in the cycle, the do-it-yourself option has become super-niche and the stores themselves might not even make that available.
Uber started as a chauffeur service, but is now available to everyone and is (mostly) a huge improvement over taxis.