Scrapegraph-ai icon indicating copy to clipboard operation
Scrapegraph-ai copied to clipboard

Facing the issue too many requests with GoogleSearch.

Open aziz-ullah-khan opened this issue 1 year ago • 5 comments

With concurrent request to googlesearch, receiving the following:

    642 def http_error_default(self, req, fp, code, msg, hdrs):
--> 643     raise HTTPError(req.full_url, code, msg, hdrs, fp)

HTTPError: HTTP Error 429: Too Many Requests

Any idea to add proxy to the google search?

aziz-ullah-khan avatar Oct 05 '24 13:10 aziz-ullah-khan