dtSearch Text Retrieval Engine .NET interface

WebSite.CrawlDepth Field

Number of links from the start page to follow.

public int CrawlDepth;

Remarks

The crawl depth is the number of levels into the web site the Spider will reach when looking for pages. When the Spider indexes a web site, it starts from the page you specify in Url, indexes that page, and then looks for links from that page to other pages on the site. For each of those pages, it looks for links to still more pages. With a crawl depth of zero, the Spider would index only the starting page. With a crawl depth of 1, it would index only pages that are directly linked to the starting page.

See Also

WebSite Class | dtSearch.Spider Namespace