Spider, Spyder

That part of a search engine which surfs the web, storing the URLs and indexing the keywords and text of each page it finds...