"Timed out receiving message from renderer"

[pogarek]

HI

Any idea how to not get "Timed out receiving message from renderer" error from Selenium while scrapping with this, AMAZING, script ?

Around 50% of downloads are timing out. When I set "Headless = False" I can see, that jobs are listed, but website still has loading gear in the tab name, like something is preventing page from getting load completely. I've tried to use Chrome 104 and 105 , also tried with chrome driver options - nothing helped.

Any ideas how to fix it?

[0828/124933.842:INFO:CONSOLE(15640)] "Unable to get user settings while calling loading container tag [object XMLHttpRequest]", source: https://static-exp1.licdn.com/sc/h/8jc8ql3b2opadbdqlfn9lirut (15640)
ERROR:li:scraper:('[my search query][EMEA]', TimeoutException('timeout: Timed out receiving message from renderer: 119.717\n  (Session info: headless chrome=105.0.5195.52)', None, None))
Traceback (most recent call last):
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\linkedin_scraper.py", line 286, in __run
    self._strategy.run(
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\strategies\authenticated_strategy.py", line 545, in run
    paginate_result = AuthenticatedStrategy.__paginate(driver, search_url, tag, offset)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\strategies\authenticated_strategy.py", line 127, in __paginate
    driver.get(url)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\webdriver.py", line 333, in get
    self.execute(Command.GET, {'url': url})
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 119.717
  (Session info: headless chrome=105.0.5195.52)

[0828/124933.863:INFO:CONSOLE(2216)] "[object Object]", source: https://static-exp1.licdn.com/sc/h/7z9jqmmzw6aba0xifibyci06h (2216)
[ON_ERROR] Message: timeout: Timed out receiving message from renderer: 119.717
  (Session info: headless chrome=105.0.5195.52)

Traceback (most recent call last):
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\linkedin_scraper.py", line 286, in __run
    self._strategy.run(
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\strategies\authenticated_strategy.py", line 545, in run
    paginate_result = AuthenticatedStrategy.__paginate(driver, search_url, tag, offset)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\linkedin_jobs_scraper\strategies\authenticated_strategy.py", line 127, in __paginate
    driver.get(url)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\webdriver.py", line 333, in get
    self.execute(Command.GET, {'url': url})
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\webdriver.py", line 321, in execute
    self.error_handler.check_response(response)
  File "C:\Users\xxxxxxx\AppData\Local\Packages\PythonSoftwareFoundation.Python.3.10_qbz5n2kfra8p0\LocalCache\local-packages\Python310\site-packages\selenium\webdriver\remote\errorhandler.py", line 242, in check_response
    raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message: timeout: Timed out receiving message from renderer: 119.717
  (Session info: headless chrome=105.0.5195.52)


[0828/124933.902:INFO:CONSOLE(0)] "Uncaught (in promise) AbortError: Aborted", source: https://www.linkedin.com/jobs/search/?currentJobId=YYYYYYYYYY&f_TPR=rMyTPR&keywords=mySearchCriteria&location=EMEA&sortBy=DD&start=50 (0)
[0828/124933.904:INFO:CONSOLE(0)] "Uncaught (in promise) AbortError: Aborted", source: https://www.linkedin.com/jobs/search/?currentJobId=YYYYYYYYYY&f_TPR=rMyTPR&keywords=mySearchCriteria&location=EMEA&sortBy=DD&start=50 (0)
[0828/124933.904:INFO:CONSOLE(0)] "Uncaught (in promise) AbortError: Aborted", source: https://www.linkedin.com/jobs/search/?currentJobId=YYYYYYYYYY&f_TPR=rMyTPR&keywords=mySearchCriteria&location=EMEA&sortBy=DD&start=50 (0)
[0828/124933.905:INFO:CONSOLE(0)] "Uncaught (in promise) AbortError: Aborted", source: https://www.linkedin.com/jobs/search/?currentJobId=YYYYYYYYYY&f_TPR=rMyTPR&keywords=mySearchCriteria&location=EMEA&sortBy=DD&start=50 (0)
WARNING:urllib3.connectionpool:Connection pool is full, discarding connection: 127.0.0.1. Connection pool size: 1
WARNING:li:scraper:('[my search query][EMEA]', 'Error in response', 'https://www.linkedin.com/jobs/search/?currentJobId=YYYYYYYYYY&f_TPR=rMyTPR&keywords=mySearchCriteria&location=EMEA&sortBy=DD&start=50', 'request_id=5624.2052 status=404 type=XHR mime_type=application/vnd.linkedin.normalized+json+2.1 url=https://www.linkedin.com/voyager/api/voyagerMessagingDashAwayStatus')
[ON_END]

Same issue appears in freshly installed Ubuntu in WSL (Windows Subsystem for Linux)..