safaribooks icon indicating copy to clipboard operation
safaribooks copied to clipboard

Remove trailing '/' in hostname

Open linanqiu opened this issue 6 years ago • 1 comments

otherwise scrapy does silly things like

2018-11-16 05:02:09 [scrapy.core.engine] DEBUG: Crawled (404) <GET https://www.safaribooksonline.com//api/v1/book/<bookid>/chapter/ch10s03.html> (referer: https://www.safaribooksonline.com/nest/epub/toc/?book_id=<bookid>)

linanqiu avatar Nov 16 '18 05:11 linanqiu

+1

csimplestring avatar Nov 19 '18 08:11 csimplestring