Artificial intelligence gave a paralyzed woman her voice back
ucsf.edu
ucsf.edu
This is nifty. Also I'm oddly comforted by the fact that this system doesn't "read thoughts". It just maps slightly upstream from actual speech to the relevant speech/motor production regions of the brain. So no immediate concern for thought hacking...
Separately, this makes me wonder what such a system would be for deaf people (with signing ability) who have lost their ability to move their arms. I imagine–optimistically–that one could just attach the electrodes to a slightly different area in the motor cortex and then once again train an AI to decode intent to signs (and speech). So basically the same system?
It sounds like a lot. Was just a thought experiment of how such spinal blocks/paralysis would affect deaf people and how they'd be able to continue to communicate with their deaf partners. Definitely niche but nonetheless interesting, and I think possible using the same general approach as the OP article.
But yeh to then translate gestures to speech is a distinct and incredibly challenging problem on its own as you allude to. Perhaps in the future they can tap into signing/speaking-translators' brains and have AI learn those mappings in a fuzzy way.
In fluent sign language, there is something analogous to phonemes. In linguistics these days, they're just called phonemes, and considered equivalent to spoken language phonemes. They're a fixed class of shapes and locations. They combine in certain ways that make up morphemes, which then make up words. It does work very similarly, perhaps identically, to spoken language.
The distribution of handshapes and they way they interact resembles spoken language. For example, it's somewhat hard to say "strengths" and people often produce a slurred "strengfs". The way it slurs together is rather predictable. It's very hard to say "klftggt", and so it just doesn't occur in natural language. Same with sign languages and hard-to-sign combinations.
Phonemes have an exact realization, but they also exist relative to each other, the distance and direction between them is important. This is probably part of why an American can fairly easily understand New Zealand English, despite nearly all of the vowels being different. Another analogy: in tonal languages, if there's a low flat tone, then 3 rising tones, then a low flat tone, that final low tone may be quite a bit higher than the first low tone -- but it will be interpreted as a low tone, as it is judged relative to the previous rising tone. Vowel qualities besides tone work the same way. And so do hand gestures.
There is a lot of variation by dialect/region/community in sign languages. More than in a language like English. This makes it more complicated, but it shouldn't be insurmountable. And of course, not all deaf people speak sign languages as their native language. They would struggle just as people who learn any other language later in life do.
...unless it could be trained on the individual?
If you're like most people, you "talk to yourself" internally all the time, so this doesn't seem that far from reading your thoughts.
https://www.media.mit.edu/projects/alterego/publications/
https://www.zdnet.com/article/mits-alterego-headset-reads-yo...
https://www.smithsonianmag.com/innovation/device-can-hear-vo...
https://en.wikipedia.org/wiki/Silent_speech_interface
This year though: https://news.mit.edu/2018/computer-system-transcribes-words-...
And https://fortune.com/2023/03/09/ai-generate-images-human-thou...
It got revitalised again recently resulting in much commotion from people on either side of the fence: shock that someone might never hear their own voice or talk to themselves inside their head, and shock that someone might have this voice talking to themselves, for somebody who has only known silence.
I think there are a couple studies that back it up, but a lot is anecdotal as people describe their side of the fence.
I have an inner voice myself, but I have thoughts and sensations that my inner voice does not voice, and some where it does.
The human brain is so freaking cool.
paper: https://www.nature.com/articles/s41586-023-06377-x
one press writeup: https://spectrum.ieee.org/brain-implant-speech
https://www.cbc.ca/news/health/paralysis-brain-speech-1.6943...
My hope is that she'll be able to cheer on their teams.
Yes, just like it prevents the prosecution from bringing in a hair expert that will testify to the court that your hair was on the crime scene.
Yes, just like it prevents the prosecution from bringing in a blood splatter expert to testify to the court only you could make this specific splatter.
As you can see, truth or efficacy isn't a prerequisite of being admitted by the court.
One is self-incriminating, the other isn't.
“There is no crime or offense when the defendant was in a state of insanity at the time of offense, or when he was constrained by a force he could not resist.
Fortunately this tech is currently very person-specific and have to be trained to the person. So to thwart it you'd just have to think applesauce over and over.
A good analogy is smartphone passwords. Authorities can't make you share your password (something you know), but they can make you unlock you phone with a fingerprint (something you have).
But then again, it seems as though being forced to reveal your password is not necessarily a violation of the 5th amendment [1]. I can't quite understand why the supreme court hasn't made a decision on this one yet. There are a lot of conflicting decisions now.
0: `nor shall be compelled in any criminal case to be a witness against himself`
1: https://www.aclu.org/news/privacy-technology/police-should-n...
See Smith vs Maryland: https://www.theatlantic.com/technology/archive/2013/12/what-...
Forcing someone to do something without payment and to their own detriment should run afoul of both the 13th and 5th amendment respectively; but if it was already reasonably and obviously known that an encrypted drive contained CSAM or national security secrets, and you have already been duly convicted of that, then it would not apply ("except as a punishment for crime whereof the party shall have been duly convicted," ), and you can be coerced into the "labor" of decryption - although double jeopardy would seem to apply, so you cannot be further charged for anything found, once decrypted.
I suggest making your passwords themselves incriminating, just to throw in another constitutional hiccup.
Not that any of this would matter in practice, but it is quite a legal thought experiment.
Gonna admit that this idea brought tears to my eyes, it's just the icing on the cake, really. And such a heartfelt decision.
Unfortunately in practice the voice still sounds quite robotic. Perhaps they could ask elevenlabs for help?
Maybe it also doesn't work well with multiple people watching?
So it must exist. An AI device that takes a thousand data points off your brain and tells you lie or not.
What would we do if we had a ~100% accurate lie detector? How would that go down, socially?
What are we living in, a dystopian sci-fi universe?
Even in the sense of political intrigue, is it so hard to imagine someone so brainwashed they truly believe the lie they are telling you?
> For weeks, Ann worked with the team to train the system’s artificial intelligence algorithms to recognize her unique brain signals for speech. This involved repeating different phrases from a 1,024-word conversational vocabulary over and over again until the computer recognized the brain activity patterns associated with all the basic sounds of speech.
To use this type of system for lie detection, if such a thing is possible, you'd have to get each subject to give you thousands of example statements with truth/lie labels. This obviously defeats the purpose, and also doesn't really seem possible - does lying for a training exercise produce the same brain patterns as lying to actually cover something up? Probably not.
Mere technical hurdles IMO.
Maybe an employee required to do so as part of on-boarding to a corporation or government org?
Or maybe someone in the process of a passport or visa application?
This podcast episode [0] with Sean Carroll and Nita Farahany scared the crap out of me on this topic, it seems inevitable.
This is the time to regulate neuro access prior to it becoming big business, and part of the TSA screening process.
[0] https://www.preposterousuniverse.com/podcast/2023/03/13/229-...
There are new infrared sensors in development that should see much more complex behavior in the brain, than say EEG. I’m sure even those could be gamed theoretically, but it will clearly become increasingly difficult as the technology improves.