GoogleScraper
GoogleScraper copied to clipboard
Not getting username and password for HTTP proxies
I am using HTTP/HTTPS proxies with my GoogleScraper module. I am currently using HTTP protocol with the proxies list in the file but when the Chrome opens for scraping, it still asks for username and password for the proxy in a dialog box.
I have also tried specifying HTTPS protocol with the proxies in the file but HTTPS proxies doesn't seem to work a little bit. And I get this error for HTTPS.
sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) CHECK constraint failed: proxy [SQL: 'UPDATE proxy SET port=?, proto=? WHERE proxy.id = ?'] [parameters: ('80', 'https', 1)]
I get the same problem. Did you find a solution for this meanwhile?
How does your proxy file look like?
like this:
87.56.88.229:1071 proxuser:freeuse