willwade

pass a txt file to this: https://abbreviation-finder.streamlit.app

This is very quick and hacky but https://github.com/willwade/Abbreviation-Finder

Yeah I agree. In reality though - right now - I'd say you might be surprised to what people actually want and need. For example I could assess someone for say a curtain opener or door opener. I have fallen into the trap of assuming that someone would want this. In reality though its very few people who do. Why? Its totally overkill and pointless when 90% they are with someone who will just open the door anyway. (NB: This isnt Everyone - the ubiquity of home control systems on the regular commercial marketplace is changing this I think)

Theres a lot of patients who "want to help out" Eddie Chang's team in SF have one patient who moved right next to the hospital to equally do this.. (NB: they should be getting paid too by the way - although thats not clear)

Yeah - this is wireless. Better than some systems which have been, no joke, a box at the top of your head with a HDMI cable in it..

> He appears to just think about where the mouse should go and then be able to click and click-and-hold. Seems like multiple inputs which an eye tracker wouldn't do. Unless maybe its just configured to click when the cursor pauses on a spot?

This is really the key question. The dwell technique you note is what most eyetrackers do (although far better to use a binary technique - eg a blink - to select because of the midas touch effect). Its built into to Windows/MacOS and iOS now. I have a sneaky feeling the reason why its chess is you can encode the positions "X1 to Y2". You can then do a transformer model to decode intentional speech..

If that is the case - then if a person actually speaks whats the benefit right now for this indvidual? (yes - that he doesnt have to say it. BUT sub-vocal speech is already achievable without invasive surgery..)

Sure. The problem is this video somewhat misses how that interaction actually works. You need a control technique of thinking to action. What that actually is and how you learn to use that is missing from the demos. Thats a tad misleading right now IMHO.. (NB: It could be intentional speech eg "Move x to y" or it could be intentional motor control "move my hand right and up" You would also need a stop command. Not sure.. )

But sure - "the potential" is the key thing in all this. Just the cost to benefit ratio is pretty dramatic right now.

I hear you. I literally cant use any commercial tracker because of a alternating strabismus and the midas touch effect is a nightmare. I'd argue Apple did that because its such a mess on regular OS where the primary input method isnt eye gaze. (They did that with iOS too - match the OS and UI to the primary access method)

I'm not sure I can believe this "This system is likely already working better than an eye tracker would for cursor control" - the training to use this stuff isnt just 'magic'. I do agree though with "and it will certainly improve" - yeah iterate.. iterate..

Some clarity for ppl. - Other techniques would likely work for this patient. Eyegaze technology is pretty readily available. He has proximity switches for driving his chair and lets not forget voice control. So.. what does BCIe offer significantly? I think this is the BIG problem BCI has. The gains are not enough for a lot of people compared to what the AT sector can already offer. Please remember this. This guy could use eyegaze or voice control on pretty regular hardware. And no surgery needed..

- These types of BCI are effectively an array of switches. You typically map a motor thought eg. "Move your arm up" => Moving the cursor up. This maybe how then you control a game such as chess if it has keyboard shortcuts. Eye movement could be done in the same way but there are easier ways. Interestingly to measure these motor commands you dont really need intracortical BCI. You can do it with surface EEG. Sticking it inside your head - closer to centres where you can measure intentional thought makes the signal cleaner and more reliable

- The big breakthroughs is really making this intracortical stuff safer and long term. Its getting there. But this isnt it

The big wins out there - are in speech BCI. Thats hardcore. Even the two main studies doing this - each of the participants requires a LOT of training time to make a Machine model work efficiently.

This is great. I'd love to see some accessibility aspects added.. This would be MASSIVE for schools with children who are learning to use switches or eyegaze or other access methods and could be educational too. (see https://www.helpkidzlearn.com/cm-info for what is kind of doing this but downpour gives way more flexibility). So: Switch scanning ability. Highlight each part in a linear way. Allow space to select that item. Enter could move the item on

Im not sure if this would work but look at https://tools.openaac.org/ see https://tools.openaac.org/demo.html and hit scan in top right for a demo

I'd be happy to offer more support on this..

I was so close to buying this. But dang. Im nearly 300Gb of photos. Thats pretty pricey for me since job security right now isnt great. Man the big guys have this sewn up. Here's wishing you guys the best of luck. I'll keep an eye on it

I'm guessing you know this is research backed as a far more effective system than using prediction (for dyslexic students and many others) right? https://onlinelibrary.wiley.com/doi/10.1002/dys.1480 https://asistdl.onlinelibrary.wiley.com/doi/abs/10.1002/asi.... (NB: You need a sentence "fixer" mode which runs without a shortcut key. Dont do all the complete formatting fixes like bullet points etc. just a prompt like "Correct any typos including finding word boundaries in this sentence")

mind sharing?

neat. is there a version anywhere you can put your own pay in?