botasaurus
botasaurus copied to clipboard
Depth limit to set how levels deep links to be crawled.
Is there any way to set the depth limit of links to be crawled ? Similar feature present in scrapy that controls how many levels deep the spider will go when following links from the initial URLs provided.