scrapy-splash

scrapy-splash copied to clipboard

Is there a way to emulate `dont_redirect` with scrapy-splash that is executing a LUA Script? Or does it natively support it? I tried adding `dont_redirect: True` to the `meta` and...

fritz-0

when i run the docker command "docker run -p 8050:8050 scrapinghub/splash", I meet this error 

ZTurboX

We had a paid Scrapy Splash plan but their customer service replies to our tickets after 10+ days Http proxies dont work with HTTPS websites, WTF? the Splash keeps hanging...

iamumairayub

Fix typo

1

datawookie

Fix typo in README

1

datawookie

Proxy connection is being refused

15

The error below suggest that my proxy connection is being refused. The proxy was tested with curl and it is infact working, it requires no credentials which is why the...

m2jobe

 Clone issue: https://github.com/scrapinghub/splash/issues/1086

hanwei996

splash works well with scrapy shell but not with scrapy-splash

1

I am using scrapy-splash to scrape a youtube video page. However, it seems the response object it's not complete when I use my spider. But I got a complete result...

BravoNatalie

Review url being optional for SplashRequest

2

As part of https://github.com/scrapy-plugins/scrapy-splash/pull/269, the `url` parameter to `SplashRequest` is no longer optional. @elacuesta noticed that this is a backward-incompatible change. Moreover, the upcoming Scrapy 2.4 will make this change...

Gallaecio

I noticed https://github.com/scrapy-plugins/scrapy-splash/pull/269 did not touch any documentation-like file, but those changes affect to the range of supported Scrapy versions. I think we need to cover (or update, if already...

Gallaecio