stop crawling

[Muneem]

Is it possible to force crawler to stop its crawling. I have condition that only 500 pages should be crawled when that condition is met ti want to stop this crawler

[amoilanen]

This is not possible at the moment, but should be quite easy to implement. I will try to add this feature in the near future.

[Muneem]

yes this feature is very good and it should be added

[Cool-Programmer]

Any news on this?

[fnmendez]

Has been couple years so... bump. Must have!

thank you

[fnmendez]

I found a workaround to stop the crawler.

Once your condition to stop is met, just set the shouldCrawl function to return false always.

crawler.shouldCrawl = () => false;