I'd get into the area myself, if I was in anyway useful with DSP code or C++..
May I ask, were your hearing issues (leading to the CI) a recent thing, or long-term? My main interest here is about using machine learning to assist people who do not know sign-language to understand signers rather than to "improve" the actual hearing process (because - personally - my S/L skills are abysmal).
I actually made the decision to be a part of the normal public school system and never learned sign language, partially out of stubbornness, so I can't really help with SL-related questions, though I'd be more than glad to answer hearing/CI-related questions.
Because people with 20/20 vision just need a sign language dictionary handy and some patience.
The dream for me is something like Google Glass with an app that can subtitle spoken, written, and signed language.
> Because people with 20/20 vision just need a sign language dictionary handy and some patience.
I would think a LOT of patience... the easiest way at that point would just to have the other person fingerspell or write what they're saying; if you're watching something where that's not possible, then the dictionary will just be an exercise in frustration.
Yeah, well that would be one way of handling it, but unfortunately the real world has terrible issues with not impeding my progress on that front. Not that I'm anti-learning, at all, but - personally - I'm fighting a losing battle against learning German, Swiss-German and Swiss-German Sign-language whilst also being a walking-talking-english-lesson :D
Taking the slow way, with dictionary in hand, is as you point out, an exercise in frustration (especially if the talker/signer is 6 years old).
Yes, I share your dream of something google-glass-like that can add subtitles. There are people working on this (mostly in the UAE, if memory serves). Interesting times ahead - hopefully I won't have to wait long, otherwise I'll have to do it myself and that really would take a while ;)
On the other hand, my cochlear implant (right side), has a directional microphone that's actually incredibly useful in noisy situations. Combined with the directional mic on the hearing aid, I can actually hear almost as well as a normal person in a crowded bar, after 20+ years of avoiding them because of how impossible they were to cope with.
I strongly recommend it if you can get it - the Nucleus Freedom 6. I'm saving my pennies up to get a second one.
I have an in-ear mic, which does wonders for reducing surrounding noises and also for letting me use a phone normally, but my main issue is with the software itself; I've had issues with it since implantation and they've always been pooh-poohed by audiologists at Hopkins, Tokyo University, and Toranomon. The biggest problem is that it seems to operate on some kind of averaging system -- when there's a noise that's louder than the recent average, everything just cuts out for a few seconds. This is especially noticeable in the morning, where I've just woken up and am trying to get to work, but there are cars and trains etc. making noise and making my hearing cut in and out constantly, which not only drives me up the wall but gives me a terrible headache.
On my hearing aid it's a "feature" that can be turned off. Too bad you're stuck with it.
I used to work at a CI manufacturer. Just thought you should know that this isn't what happens: all the features are developed by researchers or experts before even getting to the engineers, and go through clinical trials (usually several) to prove their effectiveness. They don't, and can't, add new sound processing on a whim to be 'clever'.
If the sound processing on your device is making you frustrated you should definitely discuss it with your audiologist. A lot of features can be configured or disabled completely.
I didn't actually think it was; it's just a bit of annoyed snark because this has severely impacted my QOL for a decade. :)
> If the sound processing on your device is making you frustrated you should definitely discuss it with your audiologist. A lot of features can be configured or disabled completely.
Tried it several times; she was unconvinced that it was actually affecting me. Got a new audiologist; she was convinced that the setting couldn't be changed. Moved to Japan, got a new audiologist: convinced that I'm imagining it and doesn't think the setting can be changed anyway.
I hear that a long time ago, people used to be able to buy the adapters to program their processors themselves.