requests-html

requests-html copied to clipboard

Accepting cookies dialog or removing it

3

# Problem description Hello 🙂! I am trying to obtain usable screenshots from many webpages (not just siemens like in the example). Sadly there is always some kind of pop...

ThibTrip

'Future' object has no attribute 'html'

8

``` from requests_html import AsyncHTMLSession import asyncio if asyncio.get_event_loop().is_running(): # Only patch if needed (i.e. running in Notebook, Spyder, etc) import nest_asyncio nest_asyncio.apply() req = AsyncHTMLSession() page = req.get('https://www.google.com') page.html.arender...

tjblue

How to use requests HTML to keep a session?

wangjiale1125

Bumps [bleach](https://github.com/mozilla/bleach) from 3.1.5 to 3.3.0. Changelog Sourced from bleach's changelog. Version 3.3.0 (February 1st, 2021) Backwards incompatible changes clean escapes HTML comments even when strip_comments=False Security fixes Fix bug...

dependabot[bot]

Problem using "await r.html.render()": "AttributeError: 'coroutine' object has no attribute 'newPage'"

2

Hi there, I'm encountering an issue when trying to run **await r.html.render()** to render when using the AsyncHTMLSession(). ### Error ### ``` await res[0].html.render() File "/usr/lib/python3.7/site-packages/requests_html.py", line 663, in render...

s7x

OSError: Unable to remove Temporary User Data when running multiple sessions

4

If a start two scripts that both use render I quickly get errors such as this (only one of them fails and the other script continues): > 2018-04-07 19:24:22,339 [67136]...

testvinder

Is it possible somehow to include support for html5lib parser?

4

Sometimes there are malformed HTML structures, that nor `html.parser` nor `lxml` can deal with it. In this cases `html5lib` might be helpful.

dimmg

Need method get all children

6

Hi Please add some method work with children nodes same as lxml.etree.getchildren() Currently, I'm using requests-html but sometime I must using lxml.etree to load html from Element, after that, using...

liking

There are unknow problem for the render on szwego

2

``` from requests_html import HTMLSession session = HTMLSession(browser_args=["--no-sandbox", '--user-agent=Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1']) url = 'https://a202006012055527750026253.szwego.com/static/index.html?t=1609915073594#/theme_detail/A202006012055527750026253/I202101041557160310557566' r = session.get(url) print(r.text) r.html.render() print(r.text) ``` There is content when I...

NoToPro

KeyboardInterrupt can't be caught after arender()

2

Ctrl+C can't stop the script if arender() method was called. It works as intended if you remove `loop.run_until_complete(main())` ``` import asyncio from requests_html import AsyncHTMLSession loop = asyncio.get_event_loop() async def...

mtalimanchuk