(btw, if anyone knows anything about software/hardware to do that? let me know)
It would good to have the options to voice or gesture command a desktop computer.
I created speech bindings for my most common navigation tasks:
- "Down" -> presses PgDn
- "Down a bit" -> presses "down" a few times
- "Switch" -> presses Cmd+Tab (next application)
- "Backtick" -> presses Cmd+` (next window)
- "Apple L" -> presses Cmd+L (focus address bar)
Latency was good enough. Bindings have a higher priority than dictation, so if it hears one of your custom bindings: it will immediately action it instead of waiting to hear a full sentence.
Mac version was mostly only reliable for triggering keyboard shortcuts. Dictation of sentences worked pretty well, but there were (many) significant bugs that meant it was not generally viable.
I eventually stopped because of one of the following (can't recall):
- OS updates broke it - lost the license in a computer switch - hands got better
Almost the identical use case - I sometimes sit back and use gestures to scroll, swipe browser back, swipe between desktops.
An external trackpad would also do the trick, but the mouse is ergonomically nice for when you're stretching or leaning back.