But having a robot speak to the business? That might be a bit much. Then again, if this version is only for appointments, reservations, etc, than that might be seen as acceptable in kind of the same way.
It's mostly the hesitation about when this starts going beyond that. Do you now use Google assistant to talk to friends/coworkers? "Ok, Google, ask $friend if he wants to see a movie this weekend."
You're not going to see the described scenario because there's nothing in it for Google, they have full control over both the Google Assistant ecosystem and the set of technologies powering this machine-learning interaction, and they can gate-keep it as much as they want to.
That having been said... If one company can do it, we're only N years out from the tech becoming available "in the wild" as a bailing-wired selection of open-source tools (probably in a Docker image somewhere ;) ).
Employing an AI to be your personal assistant is at least as moral as employing a human to be your personal assistant. Perhaps more, given the very limited lifespan humans have.
Give it 3 years where it's a game changer to a bigger audience and devices. I could see this complementing teachers or enabling a whole new method of interactive learning, not making appointments.