phpspider icon indicating copy to clipboard operation
phpspider copied to clipboard

Published 20 hours ago • verified publisher icon owner888

同时启动多个spider

Open shuyabin opened this issue 6 years ago • 2 comments

@owner888 大神你好..我想通过redis的 发布/订阅同时启动多个spider..会有问题嘛....

shuyabin avatar Aug 28 '17 07:08 shuyabin

其实没必要启动多个spider啊，没有意义，一个spider，就可以同时采集多个网站的

owner888 avatar Sep 02 '17 05:09 owner888

因为是想做增量采集. 两个站点的采集时间不定..

shuyabin avatar Sep 02 '17 06:09 shuyabin