• pyspider version: 0.3.10
• Operating system: centos7.3
• Start up command: pyspider all

Expected behavior

start without error

Actual behavior

An error found as follows:

` [root@localhost lib]# pyspider all [W 190419 17:18:10 run:413] phantomjs not found, continue running without it. [I 190419 17:18:12 result_worker:49] result_worker starting... [I 190419 17:18:12 processor:211] processor starting... [I 190419 17:18:12 tornado_fetcher:638] fetcher starting... [I 190419 17:18:12 scheduler:647] scheduler starting... [I 190419 17:18:13 scheduler:586] in 5m: new:0,success:0,retry:0,failed:0 [I 190419 17:18:13 scheduler:782] scheduler.xmlrpc listening on 127.0.0.1:23333 [I 190419 17:18:13 app:84] webui exiting... Traceback (most recent call last): File "/usr/local/python3/bin/pyspider", line 11, in load_entry_point('pyspider==0.3.10', 'console_scripts', 'pyspider')() File "/usr/local/python3/lib/python3.6/site-packages/pyspider/run.py", line 754, in main cli() File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 764, in call return self.main(*args, **kwargs) File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 717, in main rv = self.invoke(ctx) File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 1137, in invoke return _process_result(sub_ctx.command.invoke(sub_ctx)) File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 956, in invoke return ctx.invoke(self.callback, **ctx.params) File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/usr/local/python3/lib/python3.6/site-packages/click/decorators.py", line 17, in new_func return f(get_current_context(), *args, **kwargs) File "/usr/local/python3/lib/python3.6/site-packages/pyspider/run.py", line 497, in all ctx.invoke(webui, **webui_config) File "/usr/local/python3/lib/python3.6/site-packages/click/core.py", line 555, in invoke return callback(*args, **kwargs) File "/usr/local/python3/lib/python3.6/site-packages/click/decorators.py", line 17, in new_func return f(get_current_context(), *args, **kwargs) File "/usr/local/python3/lib/python3.6/site-packages/pyspider/run.py", line 384, in webui app.run(host=host, port=port) File "/usr/local/python3/lib/python3.6/site-packages/pyspider/webui/app.py", line 59, in run from .webdav import dav_app File "/usr/local/python3/lib/python3.6/site-packages/pyspider/webui/webdav.py", line 216, in dav_app = WsgiDAVApp(config) File "/usr/local/python3/lib/python3.6/site-packages/wsgidav/wsgidav_app.py", line 135, in init _check_config(config) File "/usr/local/python3/lib/python3.6/site-packages/wsgidav/wsgidav_app.py", line 119, in _check_config raise ValueError("Invalid configuration:\n - " + "\n - ".join(errors)) ValueError: Invalid configuration:

• Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead. `

How to reproduce

python version is 3.6.8 curl version is 7.64.1

the command

pip install --upgrade pip pip install pyspider

this command throw a error :ImportError: pycurl: libcurl link-time version (7.19.7) is older than compile-time version

pyspider

then i execute this:

cp /usr/local/lib/libcurl.so /usr/lib64/ cp /usr/local/lib/libcurl.so.4 /usr/lib64/ cp /usr/local/lib/libcurl.so.4.5.0 /usr/lib64/

this comannd throws error:

pyspider all

error:

`File "/usr/local/python3/lib/python3.6/site-packages/wsgidav/wsgidav_app.py", line 119, in _check_config raise ValueError("Invalid configuration:\n - " + "\n - ".join(errors)) ValueError: Invalid configuration:

• Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead. [root@localhost lib]# ^CFile "/usr/local/python3/lib/python3.6/site-packages/wsgidav/wsgidav_app.py", line 119, in _check_config raise ValueError("Invalid configuration:\n - " + "\n - ".join(errors)) ValueError: Invalid configuration:
• Deprecated option 'domaincontroller': use 'http_authenticator.domain_controller' instead. [root@localhost lib]# ^C`

use a older version of wsgidav

@binux

use a older version of wsgidav

why not modify /usr/local/python3/lib/python3.6/site-packages/pyspider/webui/webdav.py ?

I modified webdav.py , change 'domaincontroller': NeedAuthController(app), to 'http_authenticator':{ 'HTTPAuthenticator':NeedAuthController(app) },

then execute pyspider all it worked well

another question: pyspider not worked in python 3.7+ because the key word async ,why not fix it ?

python3.5.8 wsgiDAV==2.4.1 才解决掉，不上高版本 python了