aaronm137

My problem persists - I did not try to install the version with DEBUG messages, but my observation is that this issue occurs ONLY when I scrape website's data based...

Small update here to provide more information - after some measurements, I noticed that this is happening when there's a long 100% usage of CPUs. When I scrape data by...

@jpmckinney may I ask you how do I get access to the logs as in your example above? ``` # At startup 2025-02-19T15:26:18-0500 [scrapyd.launcher#debug] Process slot 0 ready 2025-02-19T15:26:18-0500 [scrapyd.launcher#debug]...

@jpmckinney ok, so when I run `scrapyd` on production, I get this output: ``` 2025-03-22T07:51:10+0000 [-] Loading /usr/local/lib/python3.10/dist-packages/scrapyd/txapp.py... 2025-03-22T07:51:11+0000 [scrapyd.basicauth#info] Basic authentication disabled as either `username` or `password` is unset...

@jpmckinney `/usr/local/bin/scrapyd` **pip show scrapyd**: ``` pip show scrapyd Name: scrapyd Version: 1.5.0 Summary: A service for running Scrapy spiders, with an HTTP API Home-page: https://github.com/scrapy/scrapyd Author: Scrapy developers Author-email:...