Sounds like a very good refinement of the reputation score in MTurk. For example, I usually only request workers with 95%+ acceptance rates.

The "Gold questions" sound like another refinement of the tests you can give Turks: if you have an image processing task, you can require that a worker pass a series of tests and effectively become certified before attempting your job. Are you guys trying to replace that system or complement it?