Hands-on-WebScraping icon indicating copy to clipboard operation
Hands-on-WebScraping copied to clipboard

Published 20 hours ago • verified publisher icon amitupreti

crawling by time periods

Open chupit opened this issue 4 years ago • 0 comments

Hi Amit, great cralwer!!

well done :)

Is it possible to add to the crawler the ability to crawl specific periods? right now, its running perfectly and crawl mostly 2020. Is there a way to add time based filter (for example for 2019)? I wasnt sure where to add it in the code. If you can guid me where, it would be great!

Thanks, Neta

chupit avatar May 21 '20 07:05 chupit