pyspider
pyspider copied to clipboard
A Powerful Spider(Web Crawler) System in Python.
Problem --------- On aarch64, ‘pip install pyspider’ is giving the below error - ``` ERROR: Command errored out with exit status 1: command: /usr/bin/python3 -c 'import sys, setuptools, tokenize; sys.argv[0]...
[W 220404 15:02:18 run:413] phantomjs not found, continue running without it. [I 220404 15:02:20 result_worker:49] result_worker starting... [I 220404 15:02:20 processor:211] processor starting... [I 220404 15:02:20 tornado_fetcher:638] fetcher starting... [I...
Develop
对 3.7,3.8, 3.9 进行适配 升级一些依赖库, 比如 flask 删除一些适配 python2.7 的代码 优化部分代码 调整了代码格式
* pyspider version: * Operating system: * Start up command: ### Expected behavior ### Actual behavior ### How to reproduce is there alternative project like this project? i don't understand...
* pyspider version:0.3.10 * Operating system:windows10 pro * Start up command: pyspider all Traceback (most recent call last): File "C:\Users\dell\AppData\Local\Programs\Python\Python37-32\lib\runpy.py", line 193, in _run_module_as_main "__main__", mod_spec) File "C:\Users\dell\AppData\Local\Programs\Python\Python37-32\lib\runpy.py", line 85,...
* pyspider version: `pyspider:latest `(sha256:c702f13456789a67f5abe06e37d2f38e4175010dc073c486fa646aca53dc612f) * Operating system: Windows 10 x64 * Start up command: I use docker run to start different pyspider modules ```bash # mongo docker run --name...
* pyspider version: latest version, built the master branch using docker. * Operating system: macOS Catalina * Start up command: docker-compose -f docker-compose.yaml build && docker-compose up ### Expected behavior...
* pyspider version: pyspider-0.3.10 Python 3.8.1 * Operating system: MAC Catalina V10.15.4 * Start up command: pyspider ### Actual behavior Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.8/bin/pyspider", line 11, in...