Trying new ideas isn't a waste of everyone's time, it's research.
293 karma · joined November 29, 2013
Trying new ideas isn't a waste of everyone's time, it's research.
One year later, it has an extensible plugin architecture so any site can be supported, multiple languages, and there are aready 14 plugins: (https://www.github.com/lipsurf/plugins) There's a HN plugin so you can say "click #" where # is the post rank (eg. click 5) Also "comments #", "upvote #", and "next page" are supported. This is how simple the HN plugin is: https://github.com/LipSurf/plugins/blob/master/src/HackerNew...
I'm targeting those looking for more efficient ways of using the web. Singular voice shortcuts can replace UIs and lots of navigation/finding buttons. The extension is especially useful to those who might be excluded from the web today due to accessibility issues. LipSurf enables those with motor disabilities: Parkinson's, arthritis, cerebral palsy, RSI, etc. or to those with arm injuries, spinal injuries, amputations etc.
Not everyone can use a mouse, click on small links, or navigate complex dynamic UI. So I hope this will be useful to a wide variety of people.
I am definitely going to integrate the wake word functionality into my Chrome extension that lets users control the browser via voice (https://www.lipsurf.com) so they can turn on the extension without even hitting the button.
I thought I would need to look into compiling into web assembly myself, super impressed that this too has already been done.
That was a year ago.
I think I got a bit carried away with the project -- now it can work with any site, supports multiple languages, and has a completely plugin-based architecture.
The extension is especially useful to those who might be excluded from the web today due to accesibility issues. LipSurf enables those with motor disabilities: Parkinson's, arthritis, cerebral palsy, RSI, etc. or to those with arm injuries, spinal injuries, amputations etc.
Not everyone can use a mouse, click on small links, or navigate complex dynamic UI. So I hope this will be useful to a wide variety of people.
https://chrome.google.com/webstore/detail/lipsurf/lnnmjmalak...
I added an ugly workaround, a slide to the tutorial that asks users to go into their flags and allow autoplay without any gestures. Chrome extensions should have better privileges for playing videos, fullscreening etc. IMO but it all needs to be hacked around limiting extensions.
Since voice isn't counted as a "gesture" the user can't say "play" to start a a video.
It's not just autoplay it's any sort of dynamic (js initiated) playing of media.