Roy Binux

www.baidu.com crawled in index page, would NOT crawl again in detail page.

http://docs.pyspider.org/en/latest/About-Tasks/#basis

Yes, script running is the fundamental of this project. There's a warning on readme that you can setup auth to the task page.

When no callback specified in `self.crawl`, `__call__` is used and not implemented by default.

Where did you find this log? In debug page or task status page? The script using in processor is not the same as it the second time, I guess. Maybe...

Could you please paste the schedule and process section of the task?

There is a `callback` in process section... Have no idea...

Could you reproduce this issue in demo.pyspider.org?

@robinxb You can try to reproduce it without save. On Thu, Sep 24, 2015, 11:03 AM robinxb [email protected] wrote: > @binux https://github.com/binux > I have the issue script, but I'm...

@robinxb is the issue related to certain website or could you rewrite it for some other website.