Big fan of the attempt! It's a tough area, though. A couple links that might be of interest:

A group of folks using mostly Dragon and plugins https://groups.yahoo.com/neo/groups/VoiceCoder/info

A great pycon talk by Travis Rudd a couple years ago https://www.youtube.com/watch?v=7F4ylvA0Dh0

Best wishes for a successful project!