That's not the intended behavior. I developed it on Chrome for Mac, so it should just listen continuously. If you have a second, could you let me know what OS and browser versions you're on?

Also, I agree that it could be a cool service, but my wrapper is relatively light compared to the work being done by Google, so I'm guessing you'll start to see a lot of competition in this area.