HttpDataSource Methods

The methods of the HttpDataSource class are listed here.

Protected Methods

CleanupSpider
MakeNetDate

Public Methods

Add	Add a web site to the list of sites to crawl
GetNextDoc	Get the next document from the data source.
GetStatus	Get the status of the spider
IsCrawling	Returns true if the spider is still downloading data
Rewind	Initializes the spider so the next GetNextDoc call will return the first document.
SetDebugLogging	Create a debug log recording the spider's actions
StartCrawl	Starts crawling web sites on a different thread.
StopCrawl	Requests that the spider stop crawling web sites