hey thanks for the recognition, people. :) finally, all my problems are solved. this comment is here for hacker news karma points.
I went to check out a few example searches and the too-narrow search bar is the first annoyance I found.
The next annoyance was that the crawled index seems much smaller than google's or bing's. I looked for things I know exist on twitter, on an old wordpress blog, on obscure websites I frequent: forcing terms to not be skipped using + I could see that none of my test cases were in the index.
I'm asking since I'm working on similar/different crawling problems that would make some stuff easier to just handle from the hardware I have at home, and have always assumed the provider would shut it down. Have you had any issues with that?