Mouth-based touchpad enables people living with paralysis to use computers
news.mit.edu
news.mit.edu
Personally, I'm using a lot of what I learned from the Age-Friendly folks; my 83yo mom has moved in and the learning curve, while steep, got a head start with my government experience.
One of the reasons for this last bit is that many users of assistive technologies have very dynamic situations. For example, if they have a progressive condition like ALS, their mobility and other capabilities and needs will change over time; even if the user doesn't have a progressive condition, their living situation very likely will change over time, which may involve needing to re-work their setup. This might involve something as major as moving from one care facility to another, or having to adjust to the presence of a new pump or something that causes EM interference with your device.
Even for somebody with a very static medical condition and very stable living situation, their computing setup won't be static, so will need ongoing maintenance; or, alternatively, their computing setup will become static if they end up dependent on a particular piece of assistive technology, which can lead to a whole other set of issues (which is how you get people running ancient versions of Windows for years and years and years, because it's what their eye-tracker works on, and the vendor is long out of business and so never got it working on Windows 10).
The other piece to the puzzle is that, speaking as a gross generalization, users of assistive technologies tend not to be wealthy people (many speech and motor disabilities make it challenging to work). So, you've got an expensive product, often involving ongoing operational costs, with zero economy of scale, for a small and relatively poor customer base; this all adds up to what may fairly be described as "a very challenging business". Adding another layer of complexity, the economics of commercial assistive tech in the US have a lot to do with insurance Medicaid rules; the only reason there is any commercial activity at all in assistive technology and AAC is because under some circumstances Medicaid will pay for a device, within certain very rigid and complicated boundaries. So now your business also is going to have to juggle that problem in order to keep the lights on, which will add another layer of constraint to what is already a complicated situation.
On the other hand, when the right technology is paired with the right user and the right support, the impact on the quality of life for the user and their family can be truly enormous. Which is what keeps people working in the space...
Tim was a classmate. He was and remains paralyzed from the neck down. At the computer Tim manipulated a trackball with a tool — rod connected to a flat mouth piece.
This is different, but I am not sure it is better. The trackball and stick were mostly mechanical, reliable, and straightforward to repair.
No special software. No need to charge. Tim’s tools were as reliable as a mouse. Not much of a choking hazard because of the stick either.
I’m not saying the mouth-pad is a toaster fridge. Only that it has technical complexity rather than mechanical simplicity.
Tim had a red solo cup size container next to his keyboard — he also typed with the tool in his mouth. [1] When he wanted to talk to someone, he stuck the stick in the cup and stood the tool up where he could pick it up again.
[1] I hadn’t remembered that because it’s been 25 years. Tim could also out sketch most people with a pencil in his mouth as well. He had a bachelor in fine art before the motorcycle wreck.
Products do get worked on and have been released. But yes, more work needs to be done and this product is a welcome addition.
But someone can correct me if I am wrong about this.
Do you have any insights on how this space could grow other than State Funding or Insurance policy changes?
It is so difficult to get everyone the tech that works best for them. I was part of large EU funded project that wanted to fix this with an open source ecosystem [2]. However, I had to learn that although there are many innovative and engaged people it is really hard to fix seemingly simple problems.
[0] https://www.science.org/doi/10.1126/scitranslmed.3006296
How long did you do your experiment? Obviously most of us are not typically used to point and move precisely with our feet. So to be efficient we would need to train for months but that doesn't mean we can't be precise with our feet if we were to dedicate enough time for it.
I once saw a documentary about a german woman who was born without arms. She would do everything with her feet, writing, drawing, smoking a cigarette or mounting a horse and holding the reins with one foot. We are much more adaptive than we think we are but we don't realize it when we have the luxury to not needing it.
We also build fine motor control in very young childhood; children can't color within the lines (for example) because the nerves just aren't there yet. I would expect someone born without arms to have better fine motor control of their legs than an adult that tries to develop the ability. And it takes them years - 7 or 8 years to get pretty decent control. Even if I had the neuroplasticity of a young child (I surely don't) I wouldn't want to spend years trying to develop that control.
I face this every day on the piano. You distribute motion between fingers, wrist, forearm, elbow, and shoulder based on the amount of fine control needed. Sure, you can use your shoulder to trill, but it is always going to be very slow and clumsy. finges are best, but you face fatigue, so you usually use wrist rotation to get muscles with more endurance suppling the gross motions, and then fingers for the fine control of dynamics. You can't change this physical reality, at the most you can compensate (e.g. someone with a fused wrist would have to find alternatives).
I'm not sure my feet have the accuracy to work as a mouse.
I think assistive devices do better as a class when some fraction of them are also usable or even attractive to able people as well. It gets us thinking about other modes of interaction and of course it brings the unit price for those items down out of the stratosphere.
Foot mouse will unfortunately stay niche, but when I saw the device in this article, I thought, "Why not for everybody?"
You should be thinking more of like a trackpoint for your feet/foot.
> Foot mouse will unfortunately stay niche, but when I saw the device in this article, I thought, "Why not for everybody?"
I can feel my tongue having a muscle ache just by looking at this.
Accurate foot movements are just training I bet, just like with anything else. Arm amputees have shown again and again that it's just a matter of practice. Plus, were any of us really that proficient with a mouse when we first started? We take it for granted but we've been honing that for decades.
> trackpoint
Looking at how that one works, it's just four load cells. That would be exceedingly simple to reproduce with a microcontroller that supports HID. I might actually try to make one.
* Only tongue tracking: https://www.youtube.com/watch?v=gH-z1KnIthM&t=1s * Head tracking mode (& wink to Neuralink demos :P) : https://youtu.be/6TTIsE4GMEU?si=TbS07BdjUaZDSwx4
Regarding fatigue: We constantly use our tongues for talking and eating without feeling tired and so far, current users haven’t reported tongue fatigue issues.
> “I was having trouble getting around that day,” he said, so he took the day off and did work for his consulting agency, Equal Accessibility, from bed, wearing the Vision Pro, surrounded by screens he controlled with his eyes and a series of custom mouth-sounds that triggered selections. “As I get older, and this happens more often for me,” he said, “I envision myself working virtually with the AVP even more.”
https://nymag.com/intelligencer/article/apple-vision-pro-dis...
https://9to5mac.com/2024/06/13/turn-on-iphone-eye-tracking-i...
I feel like it's probably pretty hard to get good with this.
Personally, I think I would prefer a mouth controller over a traditional controller. I am very prone to tendinitis in my hands, plus I have small hands and short fingers, and can't play twitchy games well because of it.
It is really impressive watching him live on such a competitive game.
When I do a bike ride, for me, the silence is a feature.
- Single tap on the roof of your mouth: play/pause.
- Tap on the inside of your upper left/right teeth: previous/next.
- Drag your tongue along the inside of your teeth: playback scroll.
- Drag your tongue on the roof of your mouth from front to back and back to front: volume up/down.
It seems very intuitive, and like it would be much more precise than any of the finger gestures we use today. My only concerns would be comfort, mistaken inputs, and impact on speech. But then again, some people wear dental jewelry and it doesn't seem so bad. :)
On a side note MS has some neat stuff for disabled gamers, the Adaptive Controller and they worked with Byowave on the upcoming Proteus Controller
https://www.xbox.com/en-US/accessories/controllers/xbox-adap...
https://www.byowave.com/product/proteus-controller-early-bir...
[1] Ultimate Hacking Keyboard
https://www.researchgate.net/publication/224648269_Tongue_dr...
I put a lot of pride in my independence. If I needed someone else to feed, clothe, and bathe me, I think I'd rather die. I'd feel like I was no longer living, but merely surviving.
Wish I had the bandwidth to take this on right now, because it sounds super fun and something I could be very passionate about.
People on HN complain how a substantial amount of the comments are negative. I give my honest opinion, as a doctor, knowing full well how hard it is to not only clear the hurdles to get to where they are at, but I also appreciate that it is a worthwhile endeavor. In an era where half of the people in tech are wasting their lives optimizing SEO and to sell more ads for useless crap, these people are out there making tangible improvements in people's lives.
Not related, I know.