SpiderKeeper

SpiderKeeper copied to clipboard

能否给spider起一个别名，现在spider显示的都是name的名字，这样对管理不是很友好，可否优化？

mling17

Add the ability to define: - `FEED_URI` - scrapy param that is used for storing scrapped items - `FEED_FORMAT` - scrapy param that defined file format for scrapped items -...

DoroninaD

show stats for each job

3

I added some stats information for complted jobs table. [Here is](https://screenshots.firefoxusercontent.com/images/fb6d2037-6b16-4001-a41e-86ec0c69f6c9.png) how it looks

kalombos

Bumps [jinja2](https://github.com/pallets/jinja) from 2.9.6 to 2.11.3. Release notes Sourced from jinja2's releases. 2.11.3 This contains a fix for a speed issue with the urlize filter. urlize is likely to be...

dependabot[bot]

sqlite经常锁死

1

这个怎么解决

Cesarshy

Bug in dependency - markupsafe 1.0

1

Python 3.6.9. Ubuntu 18.04.2 SpiderKeeper lists MarkupSafe 1.0 as a dependency. That version has a known issue related to setuptools. Updating SpiderKeeper to MarkupSafe >= 1.1 should fix it. https://github.com/pallets/markupsafe/issues/57#issuecomment-597105876

winston-young

非常好的东西,能监控爬虫的效率就更好了

1

点log查看有点麻烦.. 有大神指点指点吗

gameboyring

I am getting this error when add job with custom arguments. no error without argument ``` { "code": 500, "data": null, "msg": "dictionary update sequence element #0 has length 3;...

padaliyajay

任务是爬取暗网网站的信息...所以在命令行scrapy前面会加proxychains4但是用spiderkeeper中的spider不知道应该在哪加，就导致网址无法访问

Woodspen2

任务job界面的tags是什么功能

1

任务job界面的tags是什么功能？怎么添加？

Ericliu68