botasaurus icon indicating copy to clipboard operation
botasaurus copied to clipboard

get response body for cdp network

Open SpaceX-RM opened this issue 3 months ago • 0 comments

When I try to run this code:

/////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

from botasaurus.browser import browser, Driver, cdp @browser() def scrape_responses_task(driver: Driver, data): def after_response_handler( request_id: str, response: cdp.network.Response, event: cdp.network.ResponseReceived, ): url = response.url status = response.status headers = response.headers print( "after_response_handler", { "request_id": request_id, "url": url, "status": status, "headers": headers, }, ) driver.responses.append(request_id)

driver.after_response_received(after_response_handler)
driver.get("https://example.com/")
collected_responses = driver.responses.collect()

return collected_responses

scrape_responses_task()

#/////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////

I get this error:

***********************************************************************************************************************************

Traceback (most recent call last): File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus\browser_decorator.py", line 201, in run_task result = func(driver, data) File "c:\Users\hp\Desktop\Scripts\hdfc copy 3.py", line 37, in scrape_responses_task collected_responses = driver.responses.collect() File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 2050, in collect return self.driver.collect_responses(self) File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 853, in collect_responses return [self.collect_response(request_id) for request_id in request_ids] File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 853, in return [self.collect_response(request_id) for request_id in request_ids] File "C:\Users\hp\AppData\Local\Programs\Python\Python310\lib\site-packages\botasaurus_driver\driver.py", line 850, in collect_response return response UnboundLocalError: local variable 'response' referenced before assignment Task failed for input: None View screenshot at C:\Users\hp\Desktop\Scripts\error_logs\2025-09-08_16-46-29\screenshot.png We've paused the browser to help you debug. Press 'Enter' to close.

********************************************************************************************************************************

Knowing that I have implemented this matter as well:

python -m pip install bota botasaurus botasaurus-api botasaurus-requests botasaurus-driver bota botasaurus-proxy-authentication botasaurus-server --upgrade

........ I hope for a solution because I need this method a lot

SpaceX-RM avatar Sep 08 '25 13:09 SpaceX-RM