Browserfingerprinting, they see you again on ther resultspage after x seconds -> bad result. They don't see you again -> good result.
So if they look at my behaviour the way you say, then the feedback they'd get from me would be that the top x-1 results are always bad, while the xth result is always good. That sounds like a poor algorithm for them, but it might explain why my Google results always suck.