discoverer

A function of a crawler that determines which data sources are available for the crawler to retrieve information from.