SoftBank's new AI makes angry customers sound calm on phone
asahi.com
asahi.com
There could be a silver lining. A big part of the reason that it's so hard to talk to a person when you call is that people are very expensive. If the AI is cheap enough, everyone will be able to speak to a "representative" without waiting on hold or navigating a menu. It can just answer immediately and say "how can I help you" and have a conversation. And if the AI is helpful enough, fewer callers will be angry, because their problem is being solved and they aren't spending hours on hold or being asked inane questions from a script.
Silver lining for everyone except those employed in call centers, of course.
I'd say that AI can care about humans emotions, but the wonderful thing is AI doesn't have to have programmed emotional responses to emotions of others. Theoretically speaking, AI could respond to anger by applying some soothing techniques, like acknowledging emotions and active listening.
Sometimes people want to "speak to a representative" because they're too lazy to navigate a menu or search, and would prefer to use a natural language interface. AI will definitely help with that.
But for most people - especially younger people - our interface desires are not the issue. We prefer navigating a menu interface to having a conversation with anyone - AI or human!
We want to "speak to a representative" because the automated interfaces are deliberately designed not to let us do the thing we need to do. The customer service representative is not our servant, they're a guard who holds the keys to the door we need to enter.
Will companies give those keys to an LLM? I doubt it. It's certainly possible to trick CSRs, but it's easier (and more automatable) to trick LLMs. Instead, we'll get LLMs which claim to be CSRs but don't actually have any keys, bringing us back to the time-honored demand "I want to speak to a human!"
Every single time I tried to explain to the AI that my package was late and I needed a refund, replied that if the package doesn't arrive by [date that was the previous day] Then I can come back and ask for a refund.
I kept trying to explain to the bot that the date it provided me has passed but it wouldn't listen and just kept throwing me through a loop.
In the end I had a request that Amazon call me and the representative solved the problem in less than five minutes.
Nailed it. A lot of times you're doing something special or off the well beaten path, or they just don't want you to do it (like closing your account). Voice recognition usually just seems to listen to single words to try to route you to to someone. Either way, usually by that time the company doesn't care, they've got your money.
In my experience, human customer service typically sucks because the person is highly constrained by the organization in what they can and can’t do and say.
What evidence is there that companies will give AI more discretion+power than current human employees?
Then again, most customer service reps are so limited that I can easily see an AI having an equal amount of power and discretion on the things customer service reps already do. Really this would just be a push people to the next tier of support type thing in my mind.
A lot of companies expect big savings from AI customer service, so where do I assume wrong here?
Customer perception does matter.
Prior art from art: https://m.youtube.com/watch?v=naleynXS7yo
A family member had a banking problem last year (they got locked out of their account due to accidentally tripping account theft protection). Of course initially they weren't all that mad, it was their own fault. But customer support staff just had them running around in circles, gradually getting more and more infuriated until one support person finally empathized with their months of daily struggle and bothered to escalate them to someone who was able to force through a fix.
I had a similar experience with my university last year, the support employees were constantly tone deaf about the serious trouble they were causing me by asking me to drop all my other obligations immediately to deal with the consequences of their mistakes.
Every "sorry for the inconvenience" just rubbed salt into the wound because it just further emphasized that they didn't give a shit and that I had no recourse. Especially because the employees did have ways of making things better, by being proactive in providing information and making the accommodation adjustments that were within their power without my having to ask about them.
</s>
Eg letting them (to an extent) rant about the trouble being caused to them, phrasing things to not come off as confrontational or blaming, anticipating things that might trigger another outburst (eg being asked to try restarting the router when they've already claimed to have called in several times and thus may have been asked to do so several times).
…if an operator cannot tell if a customer is angry, the operator may not be able to react properly, which could just upset the customer further.
Therefore, the developers made sure that a slight element of anger remains audible.
What about angry customers with reasonable demands? Can the AI identify that?
At which point does it stop making sense to have a human at the other side? Just let frustrated humans talk to the LLMs. They aren't hurt by your frustrated voice.
As a particularly morbid example, most systems out there are not prepared, at all, for an account holder to be dead and other people need to resolve their matters. Navigating the more robust conversation trees to get to a human in those extreme edge-cases is a whole thing.
For the past year or so, the term 'customer harassment' has become a trend in Japan. It's basically customers abusing the overly polite service staff over very minor issues. This AI is introduced to combat this, as there is now a severe staff shortage in Japan due to the reducing population and companies are having trouble enticing younger people into these kinds of jobs.
Here's a good article explaining it.
https://www3.nhk.or.jp/nhkworld/en/news/backstories/3105/
> Tokyo saying no to 'customer harassment'
> Types of 'customer harassment'
> - Targeting individuals as a form of stress relief.
> - A distorted sense of justice, in which people express their feelings for a long time as advice.
> - Attack type, in which people demand things such as having a person kneel down on the ground.
> - Illusion type, in which people think they are passing the responsibility on to others.
> - Strong obsession, in which mentally unstable people are obsessed with listening to their own opinions.
The natural evolution of this technology is to insert it into human communication channels and automatically transform raw thoughts into something better for the other end of the channel. "Better" is open to interpretation and going to be very interesting in this new world, but there are so many options.
Why not a version of HackerNews that doesn't just have commenting guidelines, but actually automatically enforces them? Or a chrome extension that takes HN comments and transforms them all to be kinder (or whatever you want) when you open a thread? Or a text input box that automatically rewrites (or proposes a rewrite of) your comments if they don't meet the standards you have for yourself?
[strike]Democracy[/strike]Moderation is non-negotiable.
Typically, yes, it is.
This new moderation system sucks, who the hell thought of this?!
[What is displayed to the world]
I love this new moderation system, makes the site so much better to use!
----
You then think, fuck this, I'm deleting my account. Which you do losing access to it. But you see all your content is still there, and new posts are being made daily. Welcome to the new AI world where humans need not even apply.
Will it get this bad, no idea, but I bet some site will try it.
I think proposing a rewrite and letting people decide (and make final edits) could work well, though.
I was about to start working on something like this. I would like to try browsing the internet for a day, where all comments that I read are rewritten after passing through a sentiment filter. If someone says something mean, I would pass the comment through an LLM with the prompt: "rewrite this comment as if you were a therapist, who was reframing the commenter's statement from the perspective that they are expressing personal pain, and are projecting it through their mean comment"
I find 19 times out of 20, that really mean comments come from a place of personal insecurity. So if someone says: "this chrome extension is a dumb idea, anti-free speech, blah blah blah" , I would read: "commentor wrote something mean. They might be upset about their own perceived insignificance in the world, and are projecting this pain through their comment <click here to reveal original text>"
A couple things are really interesting about this idea. First - it's so easy for the end-user to customize a prompt that you don't need to get it right, you just need to give people the scaffolding and then they can color their internet bubble whatever color they want.
Second, I think that just making all comments just a couple percent more empathetic could be really impactful. It's the sort of systemic nudge that can ripple very far.
Customer support is one place where I don't want to just "send information". I want to be able to "exert leverage". I want my communication to be able to impel the other actor to take action.
The thing with hn comments is that the guidelines are flexible, even things that violate the guidelines are a kind of communication and play into the dynamics of the site. The "feelings" of hn have impact (for good and ill but still important).
For HN comments, I think you're right. But I think there is still lots of potential there, from tooling to help Dang use his time more effectively to tooling that you can switch on when you are in a bad mood that lets you explore your curiosity but filters out/transforms the subset of comments that you don't have the emotional capacity to deal with well.
The cool thing is that this tech can be easily layered on top of the actual forum (does vertical integration give you anything? certainly crazy expensive) and so the user can be in control of what filters/auto-moderation they embrace. Plus text makes it easy to always drill deeper and see the original as needed.
Even an individual extension or system that automatically transforms data into your desired content risks creating an artificially imposed echo chamber.
I think that ship has sailed? Agree that the ramifications of auto-transforming communication is huge, but I think I'm more optimistic. The internet is a cesspool, I think that improving things is pretty likely now that empathetic software is no longer the stuff of dreams.
On the other hand, I think there will be a tipping point where if there's enough hints that what you're saying over the phone is not exactly what the other person is hearing, you will become even more frustrated / angry and will simply stop trusting support calls in general. Humans are too perceptive.
What a dystopian future that will be, having a whole telephone conversation where neither of you hears the other's real voice.
This is actually not the worst-case outcome, in my view. The silver lining on the horizon is that hopefully there will also be a consumer-side model counterpart to these things:
I'd love to be able to just write an email. If the company is smart and offers a support email address, they can just get the text directly; if they insist on wasting my time by having only a number to call, their bot (or employee, but I suspect this will become increasingly rare soon) can argue with my bot.
> Nakatani said, “AI is good at handling complaints and can do so for long hours, but what angry customers want is for a human to apologize to them.”
An aside: is this something people really call up call centers for, for an apology? If I'm calling it's because I need something, or something is wrong and I need it fixed. I don't need a random call center person to apologize on behalf of a corporation. I just need my thing resolved.
Typically, angry customers are conveying severity and urgency. If you do not respond with a similar sense of severity or urgency you now have two people who aren't on the same page. That's not a good foundation to solve problems on.
I personally take care in this, saying things to reassure, such as indicating that I know it's the company's fault, not the rep's. This vecomes more of a "bartender" situation, where the anger is clearly at the situation, not the rep, and can create a more engaged, helpful response even.
I think one could sue for purposefully changing a person's appearance or voice, without their consent. And no, calling a help line can never ever have a tos enforced, as often the entity is required by law to deal with warranty or other issues. No tos applies.
Back to changing the voice, as others have mentioned, tenor, tone, etc all are part of speaking. They cannot be separated.
Tone is often, for example, brought up in testimony as it conveys something. It has as much meaning as the words.
I would be astonished if this isn't challenged soon.
I've worked for a cable company for a while that really turned to shit, and went into buying off representatives rather than fixing their technical problems (heavily investing in making city owned fiber illegal in many states). Customers being enraged with us was a very strong motivation for me to leave and find better work with a less abusive company. And yes, call centers commonly shut down/move/ or actually start giving better service when they can't keep staff because they are such a crap company that their users are in constant rage mode.
There will always be companies that make their customers angry. You're really going against people seeking solutions from companies they pay?
I'm amazed anyone would downvote this - how am I disillusion here?
That's the straw man. I don't see anything in the parent comment that implies or expresses that. It says
1. "There will always be a subset of people who act irate or abusively for external reasons", not 2. "All people who are irate or abusive due to external reasons"
Your flipping the implication within the sentence, then arguing against that
It's a broken system to divert money to executives and shareholders (most of whom have done zero work for the company), resulting in shittier service and anger for all of us.
BTW, I don't abuse the representatives with cursing or name calling, but I can get upset and I do let them know it's not their fault.
Our brains are wired to connect with others, and this includes picking up on and replicating emotions and behaviors. It's part of our mirror neuron system, which helps us understand and empathize with others. While this is beneficial in many social interactions, it can lead to escalation in conflict situations if not managed properly.
There's genuinely something to be said about honesty and accurately understanding someone.
Wonder how people here would like that.
It would be both terrible and hilarious. I still kind of want to see what it would look like.