Bruce Tang
Bruce Tang
i will try to use the supervisord to see if it will broken again . update 2016-12-30 my solution is use docker , and use cron to restart it every...
thanks for issue, you can open a pull request to add this clawler into the list. @AAndyProgram
This framework is a high-level browser automation , not a scrape or crawler framework.
that's right , other section like books ,demo or other things can really help to transform HTML to data will be good enough to be put in this .
1. 对当前的任务停止目前只支持到禁用到调度的功能 2. 可以考虑增加kill 任务的feature 我感觉你提出的需求,更像是要运行一次性任务那种,对吗?
这个泛型的实现,确实丑的一逼
@joeljw have you install motor ? if you read the code it need motor to save the items pip install motor
It has a confict here, could you please fix it and re push the pull request ?
after i refer this: http://stackoverflow.com/questions/33716748/python-valueerror-unknown-locale-utf-8 i update the pandas with the newest version and update the .bashrc file too ,then it pass this error