MouthPad – In-Mouth Bluetooth Mouse Uses Tongue Sensitive Trackpad
augmental.tech
augmental.tech
https://support.apple.com/guide/mac-help/move-the-pointer-us...
You can control the pointer with head movements, and click with things like blinks and smiles. All built into the OS, no 3rd party software.
Implementation of cursor defaulting to the declination button in web is waiting for its hero. Also I need to iterate between the all possible Nos on a webpage by pressing Tab/Shift+Tab key on my keyboard since no one uses this key on a web-browser any more.
And I'm glad web pages can't make use of this; that's just ripe for abuse. Though I suppose what might be acceptable would be a more limited protocol where a webpage is allowed to ask the web browser to move the pointer to a particular non-hidden UI element, and only in response to some sort of user interaction. Still, this sort of thing seems concerning.
Some tricks never die.
https://www.androidpolice.com/google-pixel-4-killed-motion-s...
Every input source has a point after which it causes fatigue or pain - hands, head, eyes, tongue, feet, etc. The more the load is spread out, the better! This MouthPad looks fantastic as another input method to share the load.
I wonder if they’ve explored trackballs? Conventional trackballs are operated with a single finger, usually the thumb, and proponents of trackballs claim it’s the equal of (or even superior to) a mouse, while touchpads and trackpoints do seem slightly limited compared to full-fledged mice. Controlling a trackball with your tongue instead of your thumb seems like it might be just as effective - maybe even more effective! This might be an avenue to make this device even more capable.
(Did I just compare the cunnilingus touchpad to the clit mouse, and then suggest adding “licking balls”? Goddamnit, lol)
I'd be concerned with the mechanical interaction of saliva with any mechanism, size concerns (this seems like it could be operated with clenched jaws if needed, opened mouth for extended periods of time can cause pain), and having moving pieces that can break or be lost (hopefully not during operation, that could be hard to swallow).
That being said trackpoint-style movement sounds better to me since my tongue has such limited motion compared to a large trackpad surface. Unless it is about to be much more dexterous than my finger (which doesn't seem right to me, but impossible to say without trying) it would be annoying to make large movements and repeated large movements seems like it would be tiring quite quickly.
However, and I hope I'm wrong here, this is looking like another case of techies with a nifty looking device that will be "available soon" but, more importantly, already tried multiple times and either never caught on for practical reasons or doesn't present a real improvement over what's already out there (0 - for three such mouth trackpads).
I wish the investors and incubators that take these companies to market would do a much better job of coaching the founders on product/market research with target users so they can focus on truly novel solutions to genuine problem spaces that are ignored, but would make a real material improvement to quality if life.
As an example, in BlindTech it was the "smart cane", which is dumb for so many reasons and will never, ever catch on, but every 6 months or so... Here pops another start up with a seed of $0.1-1M to go to market! That money would be better spent just buying "dumb" canes at a volume discount and reselling them... Or, if you insist on developing a BlindTech solution, an app that could tell a user when they missed a button on their blouse or shirt (I never worked in the paraplegic space, so I'm not sure what other challenges the users face).
(0) https://www.disabled-world.com/assistivedevices/smart-mouthw...
https://spinalcordinjuryzone.com/info/17816/glassouse-worlds...
I want to be clear - it's awesome they are putting in the effort to work in accessibility. But why will Product #4 prove profitable when it is a rehash of an approach that has been tried for years without gaining much steam above and beyond what is already there.
What is the evidence that their tweak in technology will be a major market breakthrough? Is it that much easier to use? Is it that much more comfortable? If the answer is inconclusive, then best to leave this application and find an overlooked problem paraplegics face that really could benefit from a technology solution
GlassOuse - very different form factor, bulky and limited appeal to a narrow set of the most extreme users (quadriplegics). Probably too early to market too (2017).
Smart Mouthware - what looks like a crowdfunded two person team, seems more like a brief project than a company. Doesn't seem like a serious enough effort.
Quadjoy - completely different, plugged-in product tied to a chair, very expensive ($1400).
There's all sorts of reasons for having many separate groups pursue the same idea over a period of time until one 'gets it' and defines a category [1]. This includes market timing, tech timing, component costs, financing, eng & biz talent, how the market opportunity is understood and pursued, the myriad of specific product decisions that make subtle but important differences in UX, etc.
Just from a tech timing perspective, a serious company building something in this category today would have a product that is considerably smaller, cheaper, and longer lasting than one launched just a few years ago, due to component & supply chain improvements. A smaller, cheaper device means access to a broader market, including out-of-pocket purchases and selling to users who are in a wider spectrum of disability.
[1]: I wrote about this process of getting to category defining products here, in case its of interest: https://nickpunt.com/blog/category-defining-products/
[0] Yes, there is a huge population of people who will benefit from accessible tech, unfortunately very often they cannot afford the technology and the funding is often limited
I couldn't help but chuckle when I saw what it looked like. I'm curious, what are the advantages to using this over a regular mouse?
The advantages are probably similar to those of any vertical mouse: There's much less stress on the wrist, which is important if you're suffering from e.g. RSI.
But since in this case the mouse is also ambidextrous, you can switch hands, too. (-> Useful for ambidextrous people and, also, even less stress on the individual wrist.)
Having said that, it's a dumb product because the cane is very often beaten up, or misplaced so it's an expectation that it will need replacing every 12-18 months. The additional weight needed for the hardware throws off the natural balance of the cane making it more difficult to use and also interferes with the haptic feedback users depend on from a "dumb" cane. Also, the white cane is relatively cheap ($20-50 USD) - smart canes are usually $1000+, or if the "smarts" come as attachments to an analog cane, they would range $300-500 (my intelligence is 2-3 years old, so it might be higher now), so out of reach to most blind people. None are stand-alone and require synching with the phone, but many users who are tech savvy enough to use one of these already uses a navigation app, so one of the key benefits (GPS navigation) is redundant.
Overall the drawbacks (price, negative impact on usability, natural wear and tear) greatly outweigh the possible benefits.
Everyone in the industry is genuine, there is very little profiteering, and the goal across the board is to improve people's lives, but these products are always from young techies (student or technically advanced blind person) who made an awesome project that should be celebrated. But they should also be one-offs and open-sourced, with the money and effort spent on launching smart canes that will inevitably fail in the market better spent elsewhere.
[0] https://maker.pro/arduino/projects/arduino-smart-cane-for-th...
While a mouthpad seems slighly superior to an eye tracker, the real benefit lies in having more alternatives in my opinion. So you can use your tongue when your eyes are tired and your eyes when your tongue is tired.
As you mention, the MouthPad^ would serve as an awesome tool in tandem with gaze-based cursor control. I’d like to point out that there are also other interface combinations that could work well, too. For example, we have tested using our device in tandem with voice-assistant systems and found preliminary success as our device does not prevent speech. In the end, everyone has different needs and preferences, and each interface has their quirks, so we aim to create a better option by leveraging the power of the tongue (comprised of 8 different muscles, and intrinsically dexterous).
I have found setups that work for me, and i'm comfortable now -- but I wish I had something like this years ago when I had to make accommodations.
My main worry in seeing this -- like all accessibility equipment -- is that it will be outrageously priced or locked up behind some kind of insurance coding so as to capture that segment of the market; most medical groups aim for VFW-equivalent equipment coverage on insurance, and I have no-where near that.
That said : I would love this as a device for TIG-torch actuation. That's one nut that I haven't yet been able to crack, and I was seriously considering the idea of tinkering up some kind of mouth-actuated wireless solution for welding. I can imagine this as a PC bridge to an interface that could help realize a fine control for the torch.
> I would love this as a device for TIG-torch actuation
My mom works with people with disabilities and all of her clients that I've met are like this--determined and capable.
I imagine there's a lot of people who need help in getting these tech setups going with a bunch of trial and error and then after that they can independently operate. Are there any volunteer groups that help with that?
I'm pretty out-of-touch with the accessibility/advocacy world, but should such a group exist I think that it'd be a blast to work for/with them. Giving someone back an ability is something that may be minor for some, but life-changing for others. I would imagine that it would be immensely gratifying work.
I know of groups like AbleGamers that have helped with gaming accessibility as well as providing equipment for people on a limited-basis. I think they were also one of the forces behind the XBox Adaptive Controller, which was a boon for some.
Our trains of though crossed paths here. I was thinking about how useful it might be to an able bodied person, if it would be fun or even beneficial to use. Like having a third hand in gaming would be nice sometimes. Then it immediately called to mind how outrageously expensive aid devices like this tend to be. For example an actually good hearing aid is like $2,000 for some reason. And a really nice robotic wheelchair can be like $40,000. So with disappointment I assume this thing, even if it makes it to scaled up commercial production is going to be out of my price range as someone who doesn't actually need it but wouldn't mind helping to fund the project.
Is the apparent price gouging because insurance might pay for it? Or because some people don't have a choice but to buy it?
A device like this makes a lot of sense for wearable computing. I wouldn't assume the target market are people with disabilities.
I would certainly be interested in the device purely from a keeping-both-hands-on-the-keyboard perspective.
Although our promotional video features people with quadriplegia, the MouthPad^ is designed for everyone and anyone interested in using their tongue and mouth to control their personal devices. We believe strongly in universal design, and how designing for extremes can create an improved experience for all users, and this has led us to work closely with the disability community. A classic example of the benefits of universal design can be seen in curb cuts, which were initially built into our sidewalks to help accommodate the needs of people living with mobility issues, but ended up providing value to many other groups, such as mothers with strollers, workers with carts, travelers with luggage, runners, skateboarders, etc.
https://www.inference.org.uk/dasher/
I've been thinking about it some more recently, as AI could assist with word completion, and augmenting it with some AI helpers could really improve things. And if the idea was extended.
Not wanting to sound like an able-ist snob, but interfacing with traditional computers with a keyboard is hard. And the interface is clumsy. Even touch devices and keyboards. My Mum could never use a computer, but she has worked out how to use a tablet and find videos on Youtube. I keep meaning to introduce her to voice input. As this would really benefit her.
Despite the huge tech leaps with smartphones and tablets and what not, I do feel there has been a huge regression in basic communication between people only exacerbated by the pandemic. There's knowledge available easily at people's fingertips and that's great, along with new channels of communication. But text based comms have retarded many people.
There are a number of other dimensions however that are equally important in the creation of word-sounds (e.g., whether the lips are pursed, whether the vocal folds are vibrating, whether the teeth make contact with the lips, where the tongue is located in the space of the mouth [for vowels], etc) and would make determination just from the dental/palatal axes pretty difficult I think. But maybe with enough context, you could get something predictive that is more than good enough, even if it's not into deterministic territory
Remember playing a lot with it back when it was released. Left a lasting impression and broadend my view on input mechanisms.
I can see myself pulling out the iPad on the train, and popping in the mouthpad to make navigation through Mails, Procreate, etc. easier.
[0] I tried "non-disabled" here, but that just seemed too clumsy. Am I missing an obvious term?
* broken fingers
* wearing gloves at a cold station
* a parent holding a bottle while feeding a newborn baby
* a chef working with busy/messy hands
* a computer with a dodgy mouse and no trackpad
I played around with Tobii eye-tracking hardware half a decade ago and was pretty amazed by its precision. I understand now it also has Glasses (vs. the model I tried, a tracker you put below your monitor usually). Marrying eye-tracking glasses with this mouthpad might be a winning combination: eye-tracking being the mouse to navigate in xy-space, and mouthpad for clicks.
Kudos to this group for putting out a finished product though, can't wait to see it used and iterated more out in the field.
—edit—
Mavis Beacon Teaches… umm, got nothing.
Ok, I’m done.
Our main goal in designing the MouthPad^ is to provide universal digital accessibility for all, and to explore alternative input modalities for wearable hands-free interaction. The MouthPad^ is designed for anyone interested in using their tongue and mouth to control their personal devices, including computers, tablets and smartphones. In particular, we have worked closely with the disability community as this alternative input modality provides immediate value. We strongly believe that, in working with this community, we can build a better interface for everyone. As such, we envision a future in which anyone could have a MouthPad^!
5 hours of active use with no ability to change the battery is a shit, let's be honest. It will be 4 hours after 100 full recharges, you know this process. Also Bluetooth HID devices will never be acceptable for shooters while non-Bluetooth tongue controller may be a pivot point in cyber-sport industry because of less lag between the brain and the HID.
Do you have a plans to use thermal energy or something based on movement? I would like to blow a whistle or to do something with sculls to rotate some generator.
"The tongue display unit (TDU) for electrotactile spatiotemporal pattern presentation" - https://core.ac.uk/download/pdf/82729288.pdf
Also see - https://www.newyorker.com/magazine/2017/05/15/seeing-with-yo...
Disadvantages are that you need to fully speak (whispering and sub-vocalizing doesn't work), and your voice sounds kind of funny.
Keywords is "bone conduction microphone" or "ear bone microphone".
https://openbci.com/community/synthetic-telepathy-with-subvo...
mouthpad + subvocalisation....keyboards and mice are DONEZO.
very cool shit.
Something like this would be perfect for a wearable computer. I personally want to try one, but I suspect the cost, and custom molding, are too high to "just try it out." I had a 3D scan of my mouth a few months ago for a bite guard, and it cost more than $700.
One thing that I want to point out is that the battery module next to the molars looks very uncomfortable.
Slip a finger back there and you'll find out it's not uncomfortable at all. It's really not.
How awesome would it would be to use this to control a head-mounted display like Google Glass? Imagine if I could be out in public and operate a computer without it ever being obvious that I'm doing anything—without it ever getting in the way, without it ever distracting others.
Maybe we finally have a matching input method to go with those contact-lens HUDs.
And oh man, imagine the covert opportunities this would open up. Phone not allowed? That's OK, I have a computer in my head. My limbs can be full or even tied up and I'd still be able to compute. In a threatening situation where I can't move? That's fine, I can call for help or start a recording with just the use of my tongue, without putting myself in any additional danger.
Plus, tongue control lacks a lot of the issues that BCIs normally bring up, like the difficulty of inhibiting random electrical signals in my brain. With my tongue, there is no doubt that any movement I make was entirely intended. I can be faster and more efficient because I can perform actions with more certainty and less ambiguity.
I've joined the waitlist. Digits crossed that this doesn't end up costing tens of thousands of dollars, although there's no price listed so it probably will.
1. How do you clean this? As someone who uses a mouth guard at night, they can get pretty grody if you're not meticulous with them. Can you use denture cleaner or similar on the product?
2. Are you consulting with dentists on this? It seems like you're putting an invisalign analog in your mouth and that could be potentially harmful to one's bite. Presumably if you're using this as an accessibility device the pros outweigh the cons there, but I am curious.
3. How is tongue fatigue with this? Have you found people's tongues get tired after using it for a while or has that been a non-issue?
Again, love this idea and wish you all the success.
Anyway, aside from the obvious use-case of people with motor impairment in their hands, I could see this being useful to help with the "keep hands on keyboard" mindset that causes a lot of people to eschew the use of a mouse or trackpad. You can get the best of both worlds here, keeping your hands on the keyboard at all times, but still able to move the pointer around, even while simultaneously typing.
My initial reaction was that it would be hard to learn to use a device like this, but then I started moving my tongue around on the roof of my mouth, and realized there's a lot more dexterity and fine control there than I realized. Maybe even as much as a finger. After watching their "trailer", they mention they liken the tongue to the "eleventh finger", which actually seems like a pretty apt description to me.
Jokes aside, it's really great to see innovations like this in human-machine interfaces.
Throat cancer
Imagine using this along with something like PalmOS Graffiti [2] + predictive text to send silent messages to people.
Great work, but without having the context of the video it is weird.
Out of curiosity, I had looked into getting a tongue-controlled device some years ago (to complement an eye tracking interface I had made for playing a specific game without keyboard/controller as a challenge), but had run into these two blockers.
And tongue controlled controllers aren't a novelty, they are used sometimes, but again - they are mostly one-time devices.
https://iopscience.iop.org/article/10.1088/0960-1317/8/2/028...
Unfortunately, Steven Hawking's muscular dystrophy affected his tongue as well so he was unable to use it, but it was in that context that I heard about it.
> Custom-designed MouthPad^ device
This seems expensive. I hope the future brings a more general version.
The custom design is simply a matter of business process on top of a standardized scan.
(cue Mitchell & Webb's sketch about armored scorpion of death)
However, for me it seems that I can't eat things when wearing it, or it can be hard to clean.
What do these things coast? I bet its a fortune.
You can buy a Neurosky off eBay to play with for < $200 if you're really interested in trying to do said training.
One example is asking a voice assistant to open “today’s news”, and then using the MouthPad^ to navigate through the options and select the desired link, which is captured briefly in our promotional video (a scene where Krystina is controlling her smart phone). Another example that can be found in our video is when Rocky NoHands uses his MouthPad^ to call his girlfriend, during which he is able to speak with ease. Of course, results may vary, but we have found all our test users are able to speak just fine so far.
pretty cool