ComicBookMaker icon indicating copy to clipboard operation
ComicBookMaker copied to clipboard

Published 20 hours ago • verified publisher icon SylvainDe

Crawl politely

Open SylvainDe opened this issue 8 years ago • 1 comments

Probably an interesting read: https://blog.scrapinghub.com/2016/08/25/how-to-crawl-the-web-politely-with-scrapy/ . Might be related to #36 too.

SylvainDe avatar Aug 25 '16 16:08 SylvainDe

https://thekindlyone.github.io/lessons/2015/04/03/scraping-tutorial/

SylvainDe avatar Aug 29 '16 21:08 SylvainDe