psf
Basic doc example no longer works
As doc here: https://requests-html.kennethreitz.org/
from requests_html import HTMLSession
def main() -> None:
session = HTMLSession()
r = session.get('https://python.org/')
print(f"all links = {r.html.absolute_links}")
if __name__ == '__main__':
main()
Traceback (most recent call last):
File "E:\11-Projects\learning_requests_html.py", line 1, in
I guess I should mention that it worked after installing lxml but thought I should say the docs are not correct.
Ran into the same issue. Hopefully, they update their documentation shortly.
How do i get it to work? I installed lxml_html_clean but r.html.render() still returns None because r is a Response object that doesnt have an html property
Okay, I figured it out. But only if you downgrade to version 0.9.0. I still couldnt figure out 0.10.0 because everything returns requests objects instead of requests_html objects.
The readme says to do
from requests_html import HTMLSession
session = HTMLSession()
r = session.get('https://python.org/')
rendered_html = r.html.render()
but session.get returns a requests.models.Response from the normal requests library, which doesn't have an html attribute. You actually need to call session.request instead of session.get. This function returns a requests_html.HTMLResponse, which is what we need.
from requests_html import HTMLSession
session = HTMLSession()
r = session.request(url='https://python.org/',method="GET")
rendered_html = r.html.render()