scrapy-splash

scrapy-splash copied to clipboard

Do not try to decode body of Response

3

After discussion in https://github.com/scrapy-plugins/scrapy-splash/pull/173 Decoding body of Response using only utf-8 is right way to fail. It is better to skip decoding at all. There is two problems with integration...

whalebot-helmsman

Fix some typos in the README file

1

jesuslosada

Readme updated

1

Fix for `runspider: error: No spider found in file`

ttibensky

Fail gracefully on SPLASH_URL without protocol

1

Fixes #120

Gallaecio

I have used scrapy splash for requesting in my crawling service. after amount of time my services usage of ram increase continuesly and after a while they use all ram...

Ethan353

`request_fingerprint` is deprecated in scrapy 2.7 and is replaced by `fingerprint`, Using `request_fingerprint` results in deprecation warning in logs https://docs.scrapy.org/en/latest/topics/request-response.html#std-setting-REQUEST_FINGERPRINTER_IMPLEMENTATION https://github.com/scrapy-plugins/scrapy-splash/blob/6a9eb9cd35bc81bebec9719860da5c8a5d2b35bf/scrapy_splash/cache.py#L13 https://github.com/scrapy-plugins/scrapy-splash/blob/6a9eb9cd35bc81bebec9719860da5c8a5d2b35bf/scrapy_splash/dupefilter.py#L20 https://github.com/scrapy-plugins/scrapy-splash/blob/6a9eb9cd35bc81bebec9719860da5c8a5d2b35bf/scrapy_splash/__init__.py#L10

DharmeshPandav

Copied from my [Scrapy issue](https://github.com/scrapinghub/splash/issues/1166). Maybe scrapy-splash is passing headers without my instruction? When using chromium engine in a spider to render a page that cannot be rendered with webkit...

yoonthegoon

[this specific website](http://www.crazyplumbers.com/) is throwing an exception I can't understand. `QNetworkReplyImplPrivate::error: Internal problem, this method must only be called once.` it results in the splash docker container hanging. It becomes...

JWBWork