safaribooks icon indicating copy to clipboard operation
safaribooks copied to clipboard

ERROR: Spider error processing <GET

Open rammurti84 opened this issue 7 years ago • 1 comments

2018-03-02 22:15:34 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.safaribooksonline.com/api/v1/book/9781449342562/chapter-content/ch01.html> (referer: https://www.safaribooksonline.com//api/v1/book/9781449342562/chapter/ch01.html) Traceback (most recent call last): File "c:\python27\lib\site-packages\scrapy\utils\defer.py", line 102, in iter_errback yield next(it) File "c:\python27\lib\site-packages\scrapy\spidermiddlewares\offsite.py", line 30, in process_spider_output for x in result: File "c:\python27\lib\site-packages\scrapy\spidermiddlewares\referer.py", line 339, in return (_set_referer(r) for r in result or ()) File "c:\python27\lib\site-packages\scrapy\spidermiddlewares\urllength.py", line 37, in return (r for r in result or () if _filter(r)) File "c:\python27\lib\site-packages\scrapy\spidermiddlewares\depth.py", line 58, in return (r for r in result or () if _filter(r)) File "c:\python27\lib\site-packages\safaribooks\spiders\safaribooks.py", line 179, in parse_page fh.write(template.render(body=body, style=style)) File "c:\python27\lib\site-packages\jinja2\environment.py", line 1008, in render return self.environment.handle_exception(exc_info, True) File "c:\python27\lib\site-packages\jinja2\environment.py", line 780, in handle_exception reraise(exc_type, exc_value, tb) File "

rammurti84 avatar Mar 02 '18 16:03 rammurti84

I fixed this by removing the last / in url variable in safaribooks.py

andrewvn2010 avatar Nov 20 '18 07:11 andrewvn2010