crawlee-python icon indicating copy to clipboard operation
crawlee-python copied to clipboard

Published 20 hours ago • verified publisher icon apify

BasicCrawler status logging

Open janbuchar opened this issue 10 months ago • 0 comments

  • configurable interval
  • configurable status message callback (constructor parameter, property or decorator?)
  • we periodically set the crawler status via storage client
  • in javascript crawlee, this does nothing when MemoryStorage is being used

janbuchar avatar Apr 09 '24 10:04 janbuchar