Yeah I agree, but I feel then we become very bias towards referrals and people who recruiters already trust - many developers despise recruiters for whatever reason.
As in everything, there are good recruiters and bad ones. I know several good ones who've gotten me good interviews - perhaps ask anyone on your team if they know any and consider using them.