CloudProxy icon indicating copy to clipboard operation
CloudProxy copied to clipboard

TODO: Add proxy support

Open NoahCardoza opened this issue 5 years ago • 16 comments

Proxy Support

Add a proxy parameter that will launch a browser instance and proxy traffic through the server passed in the params.

Notes:

  • Per session: https://blog.scrapinghub.com/how-to-use-a-proxy-in-puppeteer
  • Per request: https://github.com/gajus/puppeteer-proxy
  • Recommend rotating proxies rather than initiating a lot of sessions.

NoahCardoza avatar Jul 20 '20 09:07 NoahCardoza

great, i had to do it by myself)

khorezm0 avatar Jul 21 '20 15:07 khorezm0

If you’ve already made the necessary changes, feel free to open a PR. I’ll be out of town for a couple days but I’ll merge it when I get back.

Sent with GitHawk

NoahCardoza avatar Jul 22 '20 09:07 NoahCardoza

@khorezm0 Do you think you could make a PR request with your changes?

NoahCardoza avatar Jul 27 '20 04:07 NoahCardoza

My changes are quite simple so yes i can, i m gonna do it but im not home rn, so i'll do it tomorrow

khorezm0 avatar Jul 27 '20 15:07 khorezm0

Great! Thanks for the help!

NoahCardoza avatar Jul 27 '20 22:07 NoahCardoza

I'll close this as soon as I update the documentation.

NoahCardoza avatar Jul 31 '20 00:07 NoahCardoza

@khorezm0 Actually, I just noticed some changes I think I'll make to cache the proxy authentication when you initiate the instance with sessions.create since it doesn't make sense to keep passing the auth to every request, unless there is a reason you did it that way?

NoahCardoza avatar Aug 01 '20 01:08 NoahCardoza

@khorezm0 Actually, I just noticed some changes I think I'll make to cache the proxy authentication when you initiate the instance with sessions.create since it doesn't make sense to keep passing the auth to every request, unless there is a reason you did it that way?

No, there is no reasons to it, just didn't thought about it.

khorezm0 avatar Aug 01 '20 01:08 khorezm0

Alright, good to know. I'll try to fix this up by the end of the week.

NoahCardoza avatar Aug 03 '20 01:08 NoahCardoza

Been lagging on this for a while, this is a reminder for me to look into this SOON!

NoahCardoza avatar Sep 02 '20 11:09 NoahCardoza

:)

khorezm0 avatar Sep 02 '20 11:09 khorezm0

Does the latest version of CloudProxy support proxy? I added proxy = { "url": "ip:port", "username": "user", "password": "pass" } to CloudProxy request.get but it don't work. I tested with https://whatismyipaddress.com/ website.

phongtnit avatar Dec 09 '20 04:12 phongtnit

Should be not. Once it will, this issue should be closed.

khorezm0 avatar Dec 09 '20 13:12 khorezm0

Does the latest version of CloudProxy support proxy? I added proxy = { "url": "ip:port", "username": "user", "password": "pass" } to CloudProxy request.get but it don't work. I tested with https://whatismyipaddress.com/ website.

Yes it supports proxy, but it should be a proxy without AUTH. Because chrome don't accept user:password on the command line. You should set your proxy to be restricted to your ip.

serk7 avatar Dec 16 '21 22:12 serk7

how to use proxy in CloudProxy ? Help me

thanh109 avatar May 09 '23 07:05 thanh109

how to use proxy in CloudProxy ? Help me

It would be more helpful if you told us what you have tried to get it working.

Have you tried this? https://github.com/NoahCardoza/CloudProxy/pull/13#issuecomment-700149994

khorezm0 avatar May 10 '23 08:05 khorezm0