Voice Recognition Software Beats Humans at Typing
npr.org
npr.org
A couple points:
- "Typing" isn't what I'd call whatever people do while tapping away at a touchscreen keyboard. There are different actions, including swiping and tapping, but without hardware, "typing" is misleading.
- Human typing speed is variable. Many people type below 50 words per minute, but others break the 100 words per minute barrier (or more in the case of prodigies like Sean Wrona).
- To ever use this for captioning or court reporting, we'd have to overcome stenography, which is exceeding 200 words per minute. We're on a totally different level now.
If anyone wants to learn about stenography or try it out on their own keyboard for fun, check out our open source efforts at http://opensteno.org
I can speak to real person with ease, but talking to a device makes my ideas jumbled.
I guess dictation is a skill like anything else.
It is, and like any skill it improves with practice.
The primary difference I observe between typing and dictation is the latter requires more forethought and precision to produce a good result. When typing, it's easy to try out many lexical variations very quickly, because the friction of editing is extremely low. This is not true of dictation.
You may find it beneficial, as I have, to pause after each sentence and take a moment to formulate the next in general terms before continuing to speak. You need feel no urgency when dictating to a computer, and to have a general outline in mind of what you mean to say makes it much easier to do so without stumbling or hesitating partway through.
It also helps to treat dictation as a first draft, rather than a finished product. I gather that in the days when personal assistants still took dictation, they did so in order to type up a draft for review and potential correction by the person dictating the document. While we now largely dictate text to computers rather than other people, the method of treating dictation results as drafts for review still has much to recommend it.
For dictating this means planning ahead to make sure that the sentence is well-formed. Have you watched yourself type? There's a lot of backtracking, erases and restarts. The feedback from dictating is also slower, which then affects your input rate. If you do manage to ignore this and speak free flow, even with perfect recognition (which is impossible even for humans), you will have to go back and edit grammatical and cohesion errors.
The advantages of typing are faster feedback (this is unavoidable as the computational needs will always be less), working memory augmentation and better nonlinearity for edits.
When you take into account all that, the time to correct grammatical and spelling errors, to edit for comprehensibility, I doubt that speaking will come out ahead because input bandwidth is only the bottleneck for trivial pieces.
With that said, i think voice can still be superior, but perhaps i'm biased. I think what we need is an improved UX. Voice can handle the free flow part, but imagine being able to easily modify the context of the conversation via a few simple buttons. Maybe an undo button based on some context aware value (ie, not just words), and etc. The goal being to augment our ability to correct mistakes, or change the flow of the conversation.
I'm a prime example of why voice "typing" is difficult, i tend to misspeak very frequently. When using my voice, i often need to pause - which then usually causes the voice program to stop transcribing /eyeroll. Regardless, i still want to see it succeed, and think it can overall.
I would imagine the weirder comparison is that I can type my thoughts into a box just fine, but speaking them makes them all jumbled. I guess it's because I'm used to comment boxes triggering my "let's write a comment" mode, so I would need some time to get used to dictating them.
Isn't that what secretaries and court-room clerks have been doing for over a century?
Besides businessmen, also lots of succesful (print) journalists and writers in the 30s to 80s had personal assistants that they dictated their articles etc to.
For comparison, you are probably only able to type upwards of 80 to 90 words/minute using standard keyboards. And that is, again, with training.
There was a fun article recently that went over writing shorthand. Journalists used to be commonly trained in writing methods where they could get over 100 words/minute. I know of literally zero folks that are trained in that.
The thought of 100wpm on paper, though, leaves me frankly amazed.
Why is it easy to imagine doubling your speed on a keyboard with shorthand, but imagining doubling your speed on paper with shorthand amazes you?
This is what it looks like:
https://en.wikipedia.org/wiki/Shorthand#/media/File:Eclectic...
How many people know steno? No one you know, but hey that's how we chew the fat on the Internet. How many of the 7 billion people can type?
People already effectively use dictation. John Siracusa used Dragon to write his 20,000 word Mac OS reviews:
http://arstechnica.com/apple/2013/10/os-x-10-9/23/
David Pogue has been using dictation for years:
Software developers have even cobbled together voice programming solutions:
http://ergoemacs.org/emacs/using_voice_to_code.html
https://www.extrahop.com/community/blog/2014/programming-by-...
http://web.stanford.edu/~ouster/cgi-bin/wrist.php - Creator of Tcl/Tk has had RSI for a couple decades.
Also, let me throw out my standard response: "No one said..." that you have to use a keyboard or voice dictation, you have the option of using both solutions.
People don't always want to simply type fast. Imagine other use case cases, like designers, for example. They might be using a Wacom tablet and need to reach for the keyboard to "create a new layer", "change font to San Francisco", "50x100 rectangle", etc. Wouldn't voice recognition be much easier?
Here's an interesting study on chorded keyboards:
That case study interests me, but it really glazes over stenotype and palantype. I'll email Bill and see if I can get a discussion going. Cheers
Another issue is that it doesn't recognize my dialect. I don't want to talk differently just so a computer understands me.
And last (this is also an issue with autocorrect!) it doesn't like at all when I'm using nonce words. I feel like the cause is that they seem to be not as common in English as in German, and compound words are usually written as two or more words instead of one.
I have even found that it's faster for me to switch the language of the keyboard and keep using Swipe-to-Type than typing in the classic way.
A few years ago, for some work-related thing, I was looking at closed captioning for various TV channels. One channel had the most bizarre gibberish in there. What the heck... was there an error in decoding? But the words seemed like english words. Upon closer inspection, I realized that if you pronounce the gibberish sequence of words, the sounds made sense. Turns out it was a bad job of automated speech recognition.
https://support.google.com/youtube/answer/6373554?hl=en-GB
It also produces amusing gibberish if the accents are strong enough.
There are also certain words and phrases that it gets wrong much of the time. I have learnt to not use these when making voice notes. There's definitely a learning curve to use voice effectively.
Humans don't do well with that, they look at something and their brain fills it in correctly for them, it's easy to miss typos in your own work. When I used to do helpdesk and someone had password problems I'd have them retype their usernames, because they would not notice it was wrong, but it was often the problem.
More than a decade ago, I saw voice dictation working 100% perfectly. The guy who did that was being paid to do the demo by the software company that wrote the voice recognition program, and he had obviously spent a lot of hours doing demos.
He wasn't faking anything, he was just doing it really well.
Other people who have an incentive to learn it can usually do it pretty well too. They are mostly people who are using their hands for something else, eg doing autopsies, or who don't have hands.
One that bugs me is proofreading. It seems like the tools in Microsoft word could do a lot more to catch and fix mistakes and with higher accuracy.
I'm just like stop texting and call the person then!
I also have speakers with music playing