Very cool! This reminds me of crowdsourcing research done by Aniket Kittur as part of CMU's social computing lab.
Here's the relevant research paper: https://joe.cat/CHI-ka/
Looks like a very similar process you landed on except their approach has many workers crowdsourcing the answer together.