LaMDA: Google's New Conversation Technology
blog.google
blog.google
I've had a chance to play with this and it's eerie how good it is. Most impressive to me, it was able to defend itself persuasively when confronted with evidence of how its previous answers were inconsistent (in the version I played with, it tends to be very coherent but frequently wrong).
I've noticed contradictory statements are kind of standard for GPT-3. I can well believe you could come up with a system that's better at defending itself against the charge of contradiction than it is at avoiding contradictions in the first place.
I think it's a common weakness of chatbots that you can get them to contradict themselves through presenting new evidence or assertions, or even just through how you frame a question. I found LaMDA to be much more resistant to this than I anticipated, when I tried it out (I'm a Googler).
It wasn't completely immune -- I was eventually able to get it to say that, indeed, Protoss is OP -- but it took a long time.
I tried to get it to say controversial/inflammatory/bigoted things with leading questions, or questions where the framing itself was problematic, and it was quite adept at deflecting/dodging/resisting. I was very surprised.
I'm joking, I know that if it did say controversial things the headline would be "Google has created a robot fascist". You can't win at the moment....
What?? "You can't win" because this language model tries to avoid saying bigoted things? You say that like it's some sort of catch-22. It's a very desirable property and is a hard problem that needs to be solved to safely deploy these sorts of models to billions of users.
Despite changes in culture, people's nature hasn't changed in 200 years.
Discloser: xoogler here
Dialogue really is a massive missing piece in NLP (and machine interaction in general). Without dialogue, we're giving algorithms much harder tasks than we give people. A person can always ask clarifying questions before answering. (Dialogue is of course much harder for other reasons)
So it'd be really nice to read about their self-described "breakthrough" in more concrete terms than a press release that reads more like an advertisement than anything else.
[1] https://ai.facebook.com/blog/state-of-the-art-open-source-ch... [2] https://huggingface.co/facebook/blenderbot-3B
Maybe Google has it right with not anthropomorphizing Google Assistant and giving it a human name, but in that case LaMDA is a move in the wrong direction it seems: The conversations demonstrated emulated emotion in a way that generally speaking, most bots do not.
Is there any work on making difficult-to-gender voices for bots that still sound human? Maybe if we were to combine names that aren't traditionally given to humans with a voice that is hard to gender? Should we intentionally make bots/assistants sound more robotic, so they do not try to "sound human"?
I think it's kinda an interesting question to figure out what the best practice should be moving forwards.
I'm sympathetic to your points on why that's a bad vibe and might not be great when the line is blurred, but... I don't know. It seem strange to afford rights, if only conversational/social rights, to an object.
1. I don't want to feel bad for giving commands to my machine. For avoiding niceties. This is not talking about slurs, etc, but not saying 'please' or some such.
2. I agree it would be nice to avoid negativd depictions of groups. Feminine bots accepting abuse isn't great.
I guess the balance for me is kind of like what they person I was replying to said: don't make it a person. I know I'm not cruel, but it is strange to think you'd want to develop it to refuse commands if you're mean or something. I don't want that.
Maybe there is some middle ground for both types of robots?
What’s interesting to me is how this is never a problem with a traditional menu or button based UI. Maybe I’m muttering “f*ck off” as I click “Remind me later” on the umpteenth alert of the day trying to get me to update this or that, but the software would never know. (On the other hand, you could argue that the software is offending me by trying to get me to do something that is mostly in the developer’s interest, and not allowing me to say “No” - this is where being able to be frank using voice input could be quite liberating)
I wonder if the solution is to stop building bots to emulate humans: Natural language processing is important so humans can make ordinary requests of a computer without having to remember specific syntax. But perhaps we should stop trying to make the computer respond the way a human would, so that people don't view it like a human or personality.
Nothing would stop a modern system from training a new wakeword in a cloud system, if enough samples were available.
google: did you mean lambda?
If they had returned, "Showing results for lambda", "Search instead for lamda", then that would have definitely been a problem.
The main market for Google tech are brogrammers who would buy anything with buzzwords in it.
>You might expect another person to respond with something like:
>“How exciting! My mom has a vintage Martin that she loves to play.”
Not really IMO, I think they just pushed it to just say "whatever's related to the topic". People who behave like that irl come off as self-absorbed and obnoxious most of the time, hope future AIs are not like that!
California is Borg. All will be assimilated.
This so much!
One thing about the UX of all conversational products, in stark contrast with real conversations, is that it forces you into a dynamic of "one question, one answer", "one message, one reply". I can imagine it could be pretty hard to break this paradigm, but for me it's like the equivalent of the uncanny valley in this context. No matter how good the replies are, if I'm forced into this dynamic, I just know that I'm talking to a robot.
In short, I don't think it's a California unique characteristic.
Interesting. My experience (Poland/EU) is pretty much the reverse. That is, I expect a richer person to take less about themselves, and more about the topic at hand. That is (generalizing), a rich person will say things like, "$Person is a great $X-maker, you should check them out", or "yeah, X is great, especially ${some refined form}", whereas a less well-off person will keep saying things like "yes, I love X", or "I hate X", or "I'm taking X classes", or "I know ${list of famous people doing X}". My provisional explanation is that the rich person doesn't feel the need to prove anything to you, or to themselves, so they can just talk about the topic itself, instead of trying to position themselves within it.
Sure, you will find people that are a bit more self absorbed and would just pong about themselves.
But there are so many conversational constraints- asking “why” is aggressive, direct feedback is discouraged, slipping pronouns or other identity traits is a minefield, etc. You should not follow up when others say something because they were being polite and you’re putting them in evidence…
If you get to engaged in a conversation people can feel weirded out, like you’re supposed to go through the motions but that’s it.
Not talking also can get you in trouble.
Talking about yourself is probably the safest thing to do.
People talk about themselves because conversations can be intimate - they're a two way street where both parties are sharing and relating.
Because all involved parties basically look and sound the same, they judge one another according to their own local standards, instead of recognizing that they are actually interacting with a different culture.
Edit: for an additional existence proof of this midwest/coastal clash, see this comment which I had not yet read: https://news.ycombinator.com/item?id=27199709
I really can't understand how people can communicate and enjoy the conversation if literally everything is offensive.
Mountains out of molehills here.
One element of this I think is that California is highly individualistic. The people there ARE self-absorbed. It is a celebrated cultural value. It's the exact mirror of Tall Poppy Syndrome. No one cuts you down for talking about your own interests and uniqueness instead of collectivist and egalitarian topics like sports or the weather.
There's also a less intricate social code that comes from mixing together many people from different cultures. In a high-context, temporarily stable society, things get stratified and the litte social lubricants, expectations, and niceties get written into the socal contract and within the structure of the language itself (formal vs. informal forms). In a low-context and dynamic society, you are basically free to communicate without referencing the rulebook on what you should be saying or how you should be saying it and you bring less expectation that the other party will respond in some particularly scripted way.
What do people talk about where you're originally from?
If such models condition all humans to converse like that then the future is even more lonely, despite us all being connected all the time.
---
You could even ask to hear them play when you see them next.
Also, no response is also a response, you could just listen to them. No one's going to say "I just started taking guitar lessons" and remain silent for the rest of the evening; for sure they have much more to say about it.
Why is it self-absorbed for someone to include themselves in the conversation, but it's not self-absorbed for you to come up to me and talk to me about your guitar playing?
You can come up to me and say, "Hey, guess what!? I just started playing guitar!" And I can't say, "No kidding? My mom just started playing guitar, too!" or, "No way! I just started drumming a few weeks ago. Maybe we can jam soon?"
How is my response "self-absorbed" but you starting a conversation about yourself isn't?
If you start the conversation, I'm just supposed to keep asking you questions about your experience until you're done talking about it?
I mean, if we're friends, shouldn't you care about what I think is relevant as much as I should care about what you think is relevant?
And anyway, if you _really_ want to talk about how it's going - can't you just take the conversation there?
I understand if you say something like, "Nice. I've always wanted to learn to play, and I never thought I could, and already I've learned so much, and I'm getting close to being able to play my favorite song."
And I say, "Oh, cool. Hopefully you can play my favorite song next. But it's really hard, you'll probably need a few years. You know, I used to be friends with Kurt Cobain's assistant, right? That's how I got into music in the first place....."
^ That seems self-absorbed. The first seems like genuine conversation.
I think the core of this question is generosity of time and attention, each person's ability to suspend their solipsism and engage with the other person as a person of equal importance to themselves. A good conversation is an act of intimacy.
We all want to be heard but no one ever seems to want to do the listening.
I'll probably say, "Cool!!.", "Electric or Acoustic?", "Why guitar?", "How are you finding it, easy or hard - I've been meaning to take lessons". "Do you like your teacher?" ....
I guess, if my mom played and had a vintage Martin then... who knows?...
I believe the primary issue with conversational AI is that, at best, is 1-person, while humans are infinite-people. Hell, even a single person is multiple-people depending on the context and mood at that moment and other factors - in the sense that depending on context/mood/etc. a person may reply in different ways.
Conversational AI cannot capture that, it can be simply a drone..
It took me a while to learn that I can come across as self-absorbed and obnoxious in the US when speaking that way, so I have to consciously remember to ask questions about the person or the topic they presented, and avoid introducing my own related topic, but then I never know when it's OK or how to actually switch topics (since, like the article mentions, conversations do flow from on topic to another) and I become anxious during the conversation.
Even this comment is about me. Could someone suggest how I could have responded in a way that doesn't sound self-absorbed?
However, to answer your question about how to appear less "self-involved", perhaps there's a structural trick you can use, which is to shift some of your writing from first-person to second-person and speak from the outside? How does this sound to you:
"It can take a while to learn that this can come across as self-absorbed and obnoxious in the US when speaking that way, so I've learned to consciously remember to ask questions about the person or the topic they presented, and void introducing related topics. This does make it more challenging to know when it's OK or how to actually switch topics (since, like the article mentions, conversations do flow from one topic to another) and this uncertainty can be anxiety-inducing"
I'm not saying it's essential, but as an exercise if you imaging talking about the situation that way, it can influence the tone.
I will repeat that I think your fear about sounding self-absorbed does not come out, to me, in your paragraph. I have worked with colleagues whose conversations do wander off on their own tangents if they're not asked to focus, and that may be similar to what you're talking about? But I can't be sure. If so, that is the difference between conversation for its own sake where sharing and opinion and life experiences are related, and workplace conversations which often have an objective, etc.
I think it makes the conversation more personal. Anyone can say, "Oh cool! What songs have you learned?" Only _you_ (you know, the friend they chose to talk to) can say, "Oh, that's cool! My grandpa gave me a cool guitar that I've been meaning to learn to play."
I find the best approach is to sandwich a personal anecdote between two "you" statements for the people who need a prompt to carry the conversation. For example, "That's really interesting. I've also been thinking about learning guitar. How are you liking your lessons?"
Maybe I'm wrong and people secretly think I'm obnoxious, but I think it's a good thing to quickly mention something like "my mom Y" to show your familiarity with a topic, so the other person knows how much detail they need to give when talking about it. Like, if they're explaining what a certain company does in detail, and your mom works there, you should probably let them know before they explain a ton of stuff you already know.
I think the key is just to steer the conversation back quickly. If you derail it talking about yourself, steer it back with something like "So how did you like X?"
James: I’m thinking about buying a new car. Rob: Oh yeah? I’m thinking about buying a new car too. James: Really? Rob: Yup, I just test drove a Mustang yesterday and it was awesome.
I think if you actually go back to the original topic straight after, it isn't going to bother people much but if you keep talking about your thing and not showing deep understanding of theirs, it can feel like you only heard some keywords and didn't even bother to listen to what they were actually saying.
Perhaps it would be better to specify that that's how you interpret this. Your own proclivities do not represent the world.
> Not really IMO, I think they just pushed it to just say "whatever's related to the topic". People who behave like that irl come off as self-absorbed and obnoxious most of the time, hope future AIs are not like that!
I could imagine better responses, but I didn't see much wrong with that one.
If the computer says it then it's confabulating. It doesn't have a mother.
Unless they're working on role-playing, maybe it would be better to somehow remove responses that a computer shouldn't say from the training set?
This is the next steps of meena: https://ai.googleblog.com/2020/01/towards-conversational-age...
This is a real thing, but it just hasn't been opened outside of Google yet.
How long do you think it'll take ad companies to do an end run around patient protections and start serving ads based on "metadata"? Got anxiety? Try our new meds! Worried about the future? How about some life insurance or annuities? Etc. Things will get very exploitative very fast.
If they wanted to be nefarious in this way, they could just mine your chats and emails and get a great idea about your state of mind. They wouldn't even have to get around potentially legally privileged information.
My go-to related example of this: People often worry that Facebook is listening to their conversations because they'll see an ad related to a conversation soon after. You probably shouldn't worry that they might be listening to you (because they're not), but you might want to worry that they didn't need to listen to you to know what ad to serve you.
My wife and I, we experience a "Facebook is listening" event roughly every month these days. Of course I know they aren't, but these too-well-targeted ads or post recommendations aren't about generic, easy-to-guess interests - they're about completely random things that we just happened to spontaneously and briefly talk about that same day. The most likely explanation to me is that those conversation topics weren't actually spontaneous - that is, we were already primed, nudged to talk about this, and while we didn't know that, ad targeting algorithms did.
Learned about it in the documentary Century of the Self, an outstanding work.
Black Mirror was mentioned not because it pioneered this idea but because each episode shows a possible dystopian future associated with various technological advances.
These limits can and will be blown away by bots given the amount of data they can crunch. Only issue is unlike in games like Chess or Go where the end state is clearly defined, with therapy its open ended and unknown what type of end states are possible.
Just a matter of time before all paths get mapped out.
He cured my potty mouth, THAT'S NOT MY PROBLEM
It was too much emotional work to work with the training data so I haven't worked on it in a long time, but if something like that would be helpful, feel free to message me as well. :)
Or, if there's some community somewhere where people trying to solve this common problem gather, I'd love to hear about it / join!
I like Google's TTS and it was incredibly annoying to integrate with my bot. I realize they don't want you using it for free for your own purposes, but damn.
It's like talking to myself, which is what I've always done and it's always the same conversations. So I automated it.
Now half+ of it comes from outside, which seems to work better even if it's a synthetic voice with messages I made.
I also used it for nagging medication reminders, as I kept forgetting what, how and when to take (at one point it was... quite a lot, on an overly complicated schedule).
It may just be mimetic. But it feels like a Language Model with a nuance for human emotion ;)
Nowadays it doesn't know what I mean when I ask "what bus do I have to take to get to Dave". First of all, it doesn't know what to do with contacts anymore. Second: you have to say "what public transportation do I have to take to get to [Dave's location]". It just doesn't know that a bus or tram is interchangeable with public transport. Another example is asking for the last train home. Nowadays it will list you like 3 trains trains from now on but not the last one which would be hours away. Asking for when the next train comes is the same, it knows the answer but shows a list instead without saying anything.
It just gets worse and worse so that the only thing which works reliable is asking for the weather and setting alarms - which works like this for over 10 years.
I have a very hard time believing that this will result in a product we can use and if so: it will be in English only forever. Speaking of english only: their live translation overlay and their recorder app were some selling points for the Pixel at this time and to this day it's only available in English and that's it. Same for their "better artificially generated voices"
It's only marketing and I don't believe we will get anything out of this ever and if we do it's nothing like this at all.
Another question for the laMDA team: is this chatbot using any logic system, something like prolog, to connect data with goals?, in other terms, could I explain to this chatbot how a prolog system works and hope that the this chatbot is able to use some known facts and rules to deduce new knowledge?, if the system is not able to make use of some simple rules I think it utility is not going to be top notch. Finally, if the chatbot is not crippe it could provide valuable information about its own weak points to be used for (very) bad purposes.
Getting data to train BERT is fairly simple: any text can be used to drop out words and predict them. The LaMDA training text must have been more difficult to curate.
Still, while perhaps being useful for finding specific answers that already exist (among other things), it's the coming up with creative but constrained solutions that, to me, would be the real pot of gold. That may be beyond a transformer's ability.
>Ability to blend all three seamlessly (BST)
These are the same links
As per the demo, I can imagine learning about a topic through conversations with an AI. It would still be regurgitating existing knowledge, but in a conversational back and forth way, which to some can have value.
(GPT?) auto generated replies for karma building seem to be gaining traction, I wonder if it can spell the death of forums haha (most likely, it will bring in better moderation systems).
https://support.google.com/translate/thread/3508773/google-s...