Applications of human-in-the-loop systems like this are exactly why we built Scale API (www.scaleapi.com, YC S16).

Unfortunately, Mechanical Turk is often a bad choice these days for these types of applications—it's extremely difficult to guarantee quality, not to mention hard to use. Using employees also works well to a point (we did some of this at companies I've worked at too), but it doesn't scale, and should be done sparingly.

Great application of humans in the loop—this is the type of thing that really excites me. We're trending towards more and more human-augmented software, and it opens up so many possibilities for what software can do!