headless-chrome-crawler icon indicating copy to clipboard operation
headless-chrome-crawler copied to clipboard

crawler listening new request url

Open Minyar2004 opened this issue 6 years ago • 1 comments

What is the current behavior? The crawler is closed when the queue is empty

What is the expected behavior? Is there a possibility to not to close crawler but to keep it listening new url to crawl?

Please tell us about your environment:

  • Version: lastest
  • Platform / OS version: Centos 7.1
  • Node.js version: v8.4.0

Minyar2004 avatar Jul 30 '18 10:07 Minyar2004

Remove this line await crawler.close(); // Close the crawler

matheuschimelli avatar Oct 19 '18 14:10 matheuschimelli