Rotating proxy avaible ?

[Hubson93]

Hi,

Is there any possibility to retry request if response code is != 200 ? or if connection to proxy failed ?

/BR

[NikolaiT]

Does it make sense to retry the request with the exact same http headers and keywords, if only the IP address changes?

Would it not be better to completely restart the request?

[Hubson93]

Hi,yes i retry failed request. I use free proxy and sometimes it fails.

[Hubson93]

It is good to use free proxy to crawl google ? it seems that google detect those kind of proxy very fast. Does paid proxy works better ?

[NikolaiT]

Free proxies are useless, don't use them, especially for google scraping. Paid proxies work better, but often I found those proxy services to be bad. I found https://intoli.com/ to be quite good.

[Hubson93]

Thx, what do you think about MAC spoofing ? can i use changed MAC address to omit google blacklist ?

[NikolaiT]

The MAC address may be spoofed to whatever you want, all what matters to google servers is the IP address...

MAC address is only important between physical links...and on a typical route between your laptop and the google servers, there are many physical routers, switches and other hops.

[Hubson93]

So spoofed IP should works ?

[NikolaiT]

yes, changing IP address with socks5 proxy works usually fine.