Sun Panpan

如题。请参考下维基百科上面的类图： https://en.wikipedia.org/wiki/Adapter_pattern

macos中docker运行时crawler.log中报错，请帮忙看下原因。谢谢。 Traceback (most recent call last): File "crawler_booter.py", line 23, in crawler_start() File "/usr/lib/python3.6/site-packages/click/core.py", line 722, in __call__ return self.main(*args, **kwargs) File "/usr/lib/python3.6/site-packages/click/core.py", line 697, in main rv = self.invoke(ctx)...

Whether scrapy-redis can handle this situation - request urls have priority?

2

Hi, Whether scrapy-redis can handle this situation - request urls have priority? Such as I need a request URL_1 to get the basic info and another request URL_2 to get...

minishift install failed on macOS big sur

10

### General information * Minishift version: v1.34.3+4b58f89 * OS: macOS big sur * Hypervisor: hyperkit ### Steps to reproduce 1. minishift delete 2. minishift start --show-libmachine-logs -v5 ### Expected minishift...

get可以绕过cloudflare，download无法成功

2

如题所示： page = ChromiumPage() page.download_set.save_path(download_folder) page.get('https://projects.propublica.org/nonprofits/download-filing?path=05_2021_prefixes_13-13/132947386_202006_990_2021051818124406.pdf') 可以成功打开，但是： page = ChromiumPage() page.download_set.save_path(download_folder) page.download('https://projects.propublica.org/nonprofits/download-filing?path=05_2021_prefixes_13-13/132947386_202006_990_2021051818124406.pdf') 无法下载，报出了403错误 想咨询下download的实现逻辑是没有饶过cloudflare吗？ 谢谢。