distribute_crawler icon indicating copy to clipboard operation
distribute_crawler copied to clipboard
verified publisher icon gnemoug

怎么判断URL是不是该抓取

Open rfyiamcool opened this issue 10 years ago • 1 comments

怎么判断URL是不是该抓取

rfyiamcool avatar May 08 '15 17:05 rfyiamcool

这一步是通过scrapy完成的吧。url规则自己写。

nobody4t avatar May 10 '15 05:05 nobody4t