scrapy-splash

scrapy-splash copied to clipboard

scrapy-splash doesn't render the page, but splash does

2

Scrapy-splash does not render the page fully, even though Splash alone does. I want to render contents of a table with id "grid". I can see that its rendered correctly...

Ostapp

Error 400

1

An example of documentation https://github.com/scrapy-plugins/scrapy-splash (section "Examples") has the code: ``` script = """ function main(splash) splash:init_cookies(splash.args.cookies) assert(splash:go{ splash.args.url, headers=splash.args.headers, http_method=splash.args.http_method, body=splash.args.body, }) ... """ ``` Often it raise the...

vladiscripts

Update README.rst

1

`[WARNING|middleware.py:418] Bad request to Splash: {'error': 400, 'type': 'BadOption', 'description': 'Incorrect HTTP API arguments', 'info': {'type': 'bad_argument', 'argument': 'render_all', 'description': "Pass non-zero 'wait' to render full webpage"}}` if wait argument...

KimKiHyuk

I had just deployed Splash (in Docker) like a month ago on my dedicated server. I am trying to scrape a website with Scrapy Splash, but I get following error...

iamumairayub

Splash Errors: LUA Error, Infinite Loading Screen

2

I have experienced the following errors: 1 - Website loads perfectly fine with Chrome, Splash always throws this error  2 - Loading screen never finishes despite high waiting time....

benho93

I get this error: `QNetworkReplyImplPrivate::error: Internal problem, this method must only be called once.` when setting middlewares like document that's like a bug when I use in scrapy python i...

sbh96

Explain how to use scrapy-splash with AutoThrottle

3

AutoThrottle extension doesn't play nicely with scrapy-splash because it thinks requests take a very long time, and adjusts request rate accordingly.

kmike

Run doctests from README.rst

1

Gallaecio

Test cookie.path_specified == False

1

@kmike I’m extremely unsure about this change, I have no idea of the side effects it may have. I am trying to add test coverage to https://codecov.io/gh/scrapy-plugins/scrapy-splash/src/master/scrapy_splash/cookies.py#L111 This change adds...

Gallaecio

Document how to use scrapy-splash within the Scrapy shell

1

Gallaecio