pyspider icon indicating copy to clipboard operation
pyspider copied to clipboard

A Powerful Spider(Web Crawler) System in Python.

Results 113 pyspider issues
Sort by recently updated
recently updated
newest added

Problem --------- On aarch64, ‘pip install pyspider’ is giving the below error - ``` ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0]...

[W 220404 15:02:18 run:413] phantomjs not found, continue running without it. [I 220404 15:02:20 result_worker:49] result_worker starting... [I 220404 15:02:20 processor:211] processor starting... [I 220404 15:02:20 tornado_fetcher:638] fetcher starting... [I...

对 3.7,3.8, 3.9 进行适配 升级一些依赖库, 比如 flask 删除一些适配 python2.7 的代码 优化部分代码 调整了代码格式

* pyspider version: * Operating system: * Start up command: ### Expected behavior ### Actual behavior ### How to reproduce is there alternative project like this project? i don't understand...

* pyspider version:0.3.10 * Operating system:windows10 pro * Start up command: pyspider all Traceback (most recent call last): File "C:\Users\dell\AppData\Local\Programs\Python\Python37-32\lib\runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "C:\Users\dell\AppData\Local\Programs\Python\Python37-32\lib\runpy.py", line 85,...

* pyspider version: `pyspider:latest `(sha256:c702f13456789a67f5abe06e37d2f38e4175010dc073c486fa646aca53dc612f) * Operating system: Windows 10 x64 * Start up command: I use docker run to start different pyspider modules ```bash # mongo docker run --name...

* pyspider version: latest version, built the master branch using docker. * Operating system: macOS Catalina * Start up command: docker-compose -f docker-compose.yaml build && docker-compose up ### Expected behavior...

* pyspider version: pyspider-0.3.10 Python 3.8.1 * Operating system: MAC Catalina V10.15.4 * Start up command: pyspider ### Actual behavior Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.8/bin/pyspider", line 11, in...