GoogleScraper
GoogleScraper copied to clipboard
Error while using proxy-file !
While trying to use a proxy file e.g: 87.56.88.229:1071 proxuser:freeuse with this command: GoogleScraper -m selenium --keyword-file keywords.txt --num-workers 10 --proxy-file proxies.txt --search-engines "google,bing,yahoo" --output-filename holiday_rentals.jsone-file I get this error: sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) CHECK constraint failed: proxy [SQL: 'INSERT INTO proxy (ip, hostname, port, proto, username, password, online, status, checked_at, created_at, city, region, country, loc, org, postal) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'] [parameters: ('proxuser', None, 'freeuse', '87.56.88.229:1071', '', '', None, None, None, '2017-08-14 16:30:52.673639', None, None, None, None, None, None)]
Should I install & set a Mysql database ?
Did you specified proxy type like http? http 87.56.88.229:1071 proxuser:freeuse
?
no I just specified this: 87.56.88.229:1071 proxuser:freeuse
maybe this is the problem. I will test.
by adding http is doesn't work.
proxy:port user:pass is the good format. I think there is a problem while inserting the proxy info to the database.