webmagic icon indicating copy to clipboard operation
webmagic copied to clipboard

Published 20 hours ago • verified publisher icon code4craft

BloomFilterDuplicateRemover是内存操作的吗？如果爬虫重启，要怎么初始化重建？

Open yuweiming2016 opened this issue 3 years ago • 0 comments

BloomFilterDuplicateRemover是内存操作的吗？如果爬虫重启，要怎么初始化重建？因为已入库的可能有很多很多

yuweiming2016 avatar Mar 10 '21 04:03 yuweiming2016