wouldn't a crawler be a "web crawler"? It doesn't actually handle the search engine aspects.