scrapy-jsonrpc icon indicating copy to clipboard operation
scrapy-jsonrpc copied to clipboard

Scrapy extension to control spiders using JSON-RPC

Results 9 scrapy-jsonrpc issues
Sort by recently updated
recently updated
newest added

in scrapy_jsonrpc\webservice.py is this repo still alive?

scrapy-jsonrpc is not compatible with Python 3. Apart from the example client code that uses `urllib.urlopen()` : - the `crawler` resource is not found, the child resource name "crawler" needs...

help wanted

***Note:** Originally reported by @thiagof at https://github.com/scrapy/scrapy/issues/1122* I'm running a long concurrent crawl from a shell script. There are many scrapy processes running in parallel. Time to time one throw...

I tried use scrapy-jsonrpc but that error is showed: ![Screen Shot 2019-08-02 at 2 10 12 AM](https://user-images.githubusercontent.com/7611944/62348537-f4810380-b4ca-11e9-83ab-d666483244ad.png)

__import__(name) File "/Users/jerry/venv2/lib/python2.7/site-packages/scrapy_jsonrpc/webservice.py", line 7, in from scrapy_jsonrpc.jsonrpc import jsonrpc_server_call File "/Users/jerry/venv2/lib/python2.7/site-packages/scrapy_jsonrpc/jsonrpc.py", line 11, in from scrapy_jsonrpc.serialize import ScrapyJSONDecoder File "/Users/jerry/venv2/lib/python2.7/site-packages/scrapy_jsonrpc/serialize.py", line 8, in from scrapy.spider import Spider ImportError: No...

Refactored the code so that is Python3 compatible. It mostly had trouble when dealing with bytes and returning keys from dictionaries. I also added `object` in the inheritance for `JsonResource`...

Some suggestions: 1. complete your doc about how to use, please give a example in scrapy; 2. this code have some bugs, eg. [https://github.com/movingheart/django_example/blob/master/QQ%E5%9B%BE%E7%89%8720160628005154.png](https://github.com/movingheart/django_example/blob/master/QQ%E5%9B%BE%E7%89%8720160628005154.png)