crawlee-python icon indicating copy to clipboard operation
crawlee-python copied to clipboard

Polish up logging

Open janbuchar opened this issue 9 months ago • 2 comments

In the current state, we make a new logger in every module that needs to log something. There is CrawleeLogFormatter, which handles logging in the console.

  • our loggers should default to the "info" level
  • ??? the log format for Apify platform may be different (doesn't it ingest JSON? probably not, but I'm not sure)
  • in JS Crawlee, some classes accept loggers instead of creating them - we may want to revisit that
  • printing extra key-value information should now be possible via kwargs of logging.info and related methods - should we use that?

janbuchar avatar May 20 '24 08:05 janbuchar