Wow this is a terrific answer to the exact question of "what's a good unbiased web craweler" I asked yesterday in another thread [0].
Do you disclose what goes into your ranking algorithm? I think having that transparency and perhaps being able to tweak some ranking parameters would be go a long way to being able to verify it's built in the best interests of the users.