requests-html

requests-html copied to clipboard

how to render javascript in flask endpoint ?

5

Hi, I would like to render JavaScript inside a Flask endpoint. The problem is that in a multithreaded environment, the page is not rendered (due to nested threading, if I'm...

BenjaminSchmitt

Bumps [py](https://github.com/pytest-dev/py) from 1.8.1 to 1.10.0. Changelog Sourced from py's changelog. 1.10.0 (2020-12-12) Fix a regular expression DoS vulnerability in the py.path.svnwc SVN blame functionality (CVE-2020-29651) Update vendored apipkg: 1.4...

dependabot[bot]

When requesting a page that is ISO-8859-1 encoded, HTML is still interpreted as UTF-8

3

When requesting a page that is ISO-8859-1 encoded: ``` >>> r = session.get('https://gerda.geus.dk/Gerda/Search') >>> r.encoding 'ISO-8859-1' >>> r.html.default_encoding 'ISO-8859-1' >>> r.html.encoding 'utf8' >>> r.html.find("option")[-1].text 'Bygge-anl�g' ``` Expected behavior: ``` >>>...

redhog

Bumps [pygments](https://github.com/pygments/pygments) from 2.6.1 to 2.7.4. Release notes Sourced from pygments's releases. 2.7.4 Updated lexers: Apache configurations: Improve handling of malformed tags (#1656) CSS: Add support for variables (#1633, #1666)...

dependabot[bot]

Bumps [jinja2](https://github.com/pallets/jinja) from 2.11.2 to 2.11.3. Release notes Sourced from jinja2's releases. 2.11.3 This contains a fix for a speed issue with the urlize filter. urlize is likely to be...

dependabot[bot]

pyppeteer as optional dependency

4

pyppeteer is a required dependency, but fails to build on PyPy3. How about making it an optional dependency?

jonashaag

I have a distributed web-scraping system that I wanted to migrate to this tool because it makes rendering JavaScript very easy. I only needed to add a few lines to...

ExamDay

render()时utf-8' codec can't encode character '\ud83d

2

UnicodeEncodeError: 'utf-8' codec can't encode character '\ud83d' in position 12759: surrogates not allowed 这个怎么解决呢，哪里可以加错误忽略

hanpurenlirenli

JS Support is not working

1

Hey, I tried this code, which is basically the code from the doc but I am searching for different content. This is the Code: `from requests_html import HTMLSession session =...

matthias-dunkel

say, it will install with chromium together with this: ```shell pip install requests-html[chromium] ```

mo-han