1. How do. you vet the vetters (or make sure they are any good)? 2. How do you assure that they actually vet? (I see how one could just always reject/accept candidates without really thinking about it and get $80 for effort of just clicking yes/no.)
My propose solution is having "guildmasters" who somewhat manages each role. Making sure they are not scamming. These people I would know/vet in the beginning as people willing to do this initial work. Also implementing reviews for a vetter so that the vetter is held accountable.
Another solution is having the ability to hire multiple vetters to get multiple vet layers. Still will be cheaper than hiring an agency.