Number of links from the start page to follow.

public int CrawlDepth;

Public CrawlDepth As Integer

The crawl depth is the number of levels into the web site the Spider will reach when looking for pages. When the Spider indexes a web site, it starts from the page you specify in Url, indexes that page, and then looks for links from that page to other pages on the site. For each of those pages, it looks for links to still more pages. With a crawl depth of zero, the Spider would index only the starting page. With a crawl depth of 1, it would index only pages that are directly linked to the starting page.