Sonu Pandey

Results 2 issues of Sonu Pandey

Is there any way to set the depth limit of links to be crawled ? Similar feature present in scrapy that controls how many levels deep the spider will go...

I am using Request decorator. earlier it was working fine. but now I am getting issue in that it never return failed state, in case of failure it always stucks...