The downside of AI language translation
theatlantic.com
theatlantic.com
The phrase was: we didn't sleep too well; it was strange because it was the first sentence of a top-rated review. Why would someone give a top score to a place where they didn't sleep well?
But it was an (automatic) translation from French. The original French version was: on n'a super bien dormi.
That's incorrect: it should read on a super bien dormi, which means "we slept really well". But when said out loud it should sound like on na super bien dormi because the n at the end of "on" is supposed to create a "liaison" with the following "a" so that it's more fluid.
Yet, when written as "on n'a super bien dormi" then the extra "n'" could be construed as a negative -- most French native speakers will intuitively understand that it's not, it's just a spelling mistake; but the automatic translation machine doesn't (at least on booking.com: I just checked on Google Translate and it doesn't fall for it!)
This got me thinking: would it be possible to craft special texts that would mean one thing in one language, and a totally different thing when machine-translated in another language? That would be quite funny -- or terrifying, depending on the context.
LLMs have enough common sense to get those things unlike the old translators.
This is the subject of age-old jokes. Here's one that I know off the top of my head, but I'm sure plenty of others have their favorite joke translations.
Rumor is that USA translators first attempt at automatic English to Russian and back to English was the Biblical Phrase: "The Spirit is willing but the flesh is weak" (Jesus's parable about how even if you want to do the right thing, it feels like we act against what we want to do sometimes).
Allegedly, translated into Russian, and back into English, results in:
"The Vodka is Strong but the meat is rotten".
One case was a terms and conditions thing, where the translation claimed that the supplier would assume all liability for misuse of the product, which was clearly not what the French (or common sense) intended.
When everything we do becomes easy and we can just ask an AI/robot to do it for us, how will humans replace the meaning that comes from skill acquisition/performance?
Antoine de Saint-exupéry had a similar way to put it: "It's the time you wasted on your rose that makes your rose so important"
I don't know why he chose that word, but I love that choice "waste" (perdre in original French). So telling.
I think this captures the spirit even better, since the time sure is lost, but not wasted.
An example in my own life: an AI I'm sure can perform a piano piece (via MIDI) better than I can, but I've literally never considered this has any bearing on how much I like paying piano.
He's very conversational now, and I am very not...
It is in some ways a bit peculiar, with a simple grammar but extensive vocabulary (much of which thieved from other languages). It is on the face of it quite ugly, however great poetry and works of literature have been created using it. Some non-native speakers say they feel freer using English instead of their native tongue, but of course that is a somewhat nebulous proposition hard to substantiate, even if there is a little truth to it.
I suppose there's still the issue of inconsistent phonetics when reading an unfamiliar word...
Many of the French words came about due to England being invaded by he Norman French. A lot of food words come about due to using the native terms for those -- this is why the meat words are French based and the animal words are Norse/Germanic.
In Florida, you see a lot of Spanish words entering English due to the cultures co-existing and mixing. This happends a lot near country borders where you see languages blend together as the different speakers mix.
Do creole languages (of which there are many) steal the words from their parent languages?
Probably why technical term is loanword :)
... it's not like the word gets used up in the original language [1]
Humans are way too clever and adaptable to receive and reify one language and will always be tuning in to accidental quirks and personal optimizations. There will always be many languages, some old and some new, because people will always live within the practical little social bubbles that get them from today to tomorrow.
On a funny side note, I recently overheard one Spanish speaker casually comment to another about how people's personalities seem to change when they switch which language they're speaking. It was wild to see someone who's never heard of that hypothesis just invent all on their own.
I disagree. I'd argue that a monolingual species is harmful for the same reason monocultures are harmful in general.
Language diversity facilitates cultural diversity. It's a "memetic speed bump" that enables the isolation needed for cultural divergence.
On a hundred-year timescale, I'd much rather see hundreds of new, diverse cultures bloom than some sort of bland Facebook-y monoculture where everyone is communicating with everyone else all the time. I'm hoping in the very long run, space travel will help facilitate cultural diversity. E.g. Mars is ~10 light-minutes away, meaning Earth/Mars phone calls aren't really feasible. But until then, we should preserve the cultural diversity we have, and fight homogenization.
hose languages have barely any presence online, so there isn't remotely enough data to make a good translator... just look at Whisper accuracy for less institutional languages, for a reference
Now we made this huge jump in AI capabilities, and I am really surprised that he mostly seems to have negative feelings about it.
To me, it is quite the opposite. With these new LLMs, a childhood dream has come true. And I am mesmerized by the progress and possibilities.
I didn't read this as him saying, "We won't learn new languages," but rather, "We won't be forced to, and learning a new language is a wonderful thing. In our gain, let's not lose sight of what we're losing."
Well, they were completely right, just a century or so off on the timeline…
Whether Star Trek is aspirational or inspirational, I guess we'll have to see.
He now perceives AI to be a tool that will limit, deny, or replace these feelings & experiences, and so has shifted his relationship to its potential. I'm slightly surprised that he sees AI this way, but not at all surprised this is how he feels about it given that he does. I think it's too early to say if he's right but his feelings are certainly consistent with his views and long history of playful curiosity.
Machine Translation is great and can mean the world for minority languages, but now everyone language learning app has to have a chatbot, which, I think, it does replace human conversation when learners say that now they don't need tutors etc.
> There may be programs which can beat anyone at chess, but they will not be exclusively chess players. They will be programs of general intelligence, and they will be just as temperamental as people. "Do you want to play chess?" "No, I'm bored with chess. Let's talk about poetry." That may be the kind of dialogue you could have with a program that could beat everyone. That is because real intelligence inevitably depends on a total overview capacity-that is, a programmed ability to 'jump out of the system", so to speak-at least roughly to the extent that we have that ability. Once that is present, you can't contain the program; it's gone beyond that certain critical point, and you just have to face the facts of what you've wrought.
to [1]
> Although my prediction about chess-playing programs put forth there turned out to be embarrassingly wrong (as the world saw with Deep Blue versus Kasparov in 1997), those few pages nonetheless express a set of philosophical beliefs to which I am still committed in the strongest sense.
and now to
> Why would anyone want to devote thousands of hours to learning a foreign language if, by contrast, they could simply talk into their cellphone and it would instantly spit out “the same message” in any language of their choice, in their own voice, and with a perfect accent to boot?
not to mention his other articles recently. It's as if he forgot that there are still human beings learning, playing, and competing in chess or go, dedicating thousands of hours of their lifetime to it.
[0] both copied from GEB
It's really sad to see something like this happen to him.
Instead of seeing it as everyone having an amazing language coach in their pocket. Or finding ways to radically accelerate language learning. Or of bringing everyone together but still having those few core languages you know (you will always be ignorant of most languages). Or of saving languages that might otherwise die. He focuses on a hypothetical negative.
Age is the ultimate disease.
It's true that old fogey skeptics who have vested interest in the old ways are disposed towards motivated reasoning, but they're also the ones most able call out the motivated reasoning by the few who make disproportionate profit most from pushing new technologies.
I strenuously disagree. The people with most to lose have the least objectivity and the greatest tunnel vision. There’s no silver lining to such bias. Being able to shoe a horse doesn’t give you special insight into civil engineering and sociological trade-offs.
Hofstadter was a brilliant and up-and-coming AI researcher in his 20s, wrote an amazing book, started the Fluid Analogies Research Group, and was going to create the next generation of AI based on the power of analogies.
Then for decades -- nothing. His work on analogy was completely overtaken by deep learning. Recently there was an article on his partial recanting of the whole idea of analogy as the core of cognition, something which has been foundational to his research.
Wordplay and translation always figured prominently in both his popular writing and his research as examples for the power of analogy. He has a whole book on translation, for example.
So it's hardly surprising that when the very "stupid" approach of backprop on a neural net can work with analogy better than any system he's ever created that he might focus on the negatives. His entire research project has been usurped.