scrapedin-linkedin-crawler icon indicating copy to clipboard operation
scrapedin-linkedin-crawler copied to clipboard

Skip Profiles already downloaded

Open ishandutta2007 opened this issue 3 years ago • 0 comments

Is there an option to skip profiles that are already downloaded in "saveDirectory". The reason I am asking this is whenever it encounters some error and have to run it again with same "rootProfiles", it starts downloading everything from scratch, why can't it process filenames already present in "saveDirectory" and parse accordingly?

ishandutta2007 avatar Aug 15 '20 00:08 ishandutta2007