changedetection.io icon indicating copy to clipboard operation
changedetection.io copied to clipboard

Using proxies the browser steps arent loading (ERR_TUNNEL_CONNECTION_FAILED)

Open opicron opened this issue 2 years ago • 1 comments

Describe the bug Fetch method: Playwright Chromium/Javascript via 'ws://playwright-chrome:3000/?stealth=1&--disable-web-security=true'

When using Brightdata proxies the browser steps are not loading. The browserless/chromium docker exits with: Failed to load resource: net::ERR_TUNNEL_CONNECTION_FAILED.

When using the proxied watch without browser steps it works fine.

So, my workaround is now:

  • Set up watch without proxy
  • Select browser steps without proxy
  • Turn on the proxy

I can live with that but I thought I should make a note here.

Version 0.40.1.1

To Reproduce Add watch Use Playwright fetch method Select Brightdata proxy Try to use browser steps

https://changedetection.io/share/ARfnCoA0Ho4a

Expected behavior I expect the browser steps to load eventually.

Screenshots n/a

Desktop (please complete the following information):

  • OS: Synology docker
  • Browser: Brave

opicron avatar Jan 23 '23 11:01 opicron

thanks for the solid report!

dgtlmoon avatar Jan 23 '23 15:01 dgtlmoon

How did you configure the proxy? via proxy.json or?

dgtlmoon avatar Feb 17 '23 16:02 dgtlmoon

@opicron when this happens, can you see something in the output logs like Browser Steps: UUID {} Using proxy {}" ? can you paste it? is that value in what it says what you configured?

dgtlmoon avatar Feb 17 '23 16:02 dgtlmoon

Starting connection with playwright                                                                                                
Starting connection with playwright - done                                                                                         
Browser Steps: UUID 28179fca-fbc3-4258-9111-3ebdf4c9eb2f Using proxy http://xxxxx (CORRECT USER:PASS@PROXY )                                                                                                     
Time to browser setup 2.0946834087371826                                                                                           
192.168.1.1,172.17.0.1 - - [27/Mar/2023 07:21:15] "GET /browser-steps/browsersteps_update?uuid=28179fca-fbc3-4258-9111-3ebdf4c9eb2f
&browsersteps_session_id=1679901668054 HTTP/1.1" 200 218 6.813348                                                                  
(7) accepted ('172.17.0.1', 50234)                                                                                                 
> action calling goto_url                                                                                                          
Browser steps console - error: Failed to load resource: the server responded with a status of 407 (Proxy Authentication Required) [
]                                                                                                                                  
Time to goto URL  1.2221226692199707                                                                                               
Browser steps console - error: Failed to load resource: net::ERR_TUNNEL_CONNECTION_FAILED []                                       
Call action done in 5.096179485321045  

The proxies are added through proxies.json in the main datastore folder.

When this happens I have to reset the docker because it because very unresponsive.

opicron avatar Mar 27 '23 07:03 opicron

I changed from proxies.json to the configuration frontend. The same result, fetching works, but browser steps do not work.

opicron avatar Mar 28 '23 07:03 opicron

I'm having the same issue on version 0.41. Browser steps always throws a 400 error. Also non proxied requests all fail, but the visual filter selector still works.

pedrogius avatar Apr 26 '23 17:04 pedrogius

Closed by this commit, you can use the latest docker image or master branch code https://github.com/dgtlmoon/changedetection.io/commit/cf3f3e44977f72c12d73b5807c4998993d236332

dgtlmoon avatar May 07 '23 13:05 dgtlmoon