crawlee-python
crawlee-python copied to clipboard
Polish up logging
In the current state, we make a new logger in every module that needs to log something. There is CrawleeLogFormatter
, which handles logging in the console.
- our loggers should default to the "info" level
- ??? the log format for Apify platform may be different (doesn't it ingest JSON? probably not, but I'm not sure)
- in JS Crawlee, some classes accept loggers instead of creating them - we may want to revisit that
- printing extra key-value information should now be possible via
kwargs
oflogging.info
and related methods - should we use that?