GoogleScraper icon indicating copy to clipboard operation
GoogleScraper copied to clipboard

Error while using proxy-file !

Open mlifemaker opened this issue 7 years ago • 3 comments

While trying to use a proxy file e.g: 87.56.88.229:1071 proxuser:freeuse with this command: GoogleScraper -m selenium --keyword-file keywords.txt --num-workers 10 --proxy-file proxies.txt --search-engines "google,bing,yahoo" --output-filename holiday_rentals.jsone-file I get this error: sqlalchemy.exc.IntegrityError: (sqlite3.IntegrityError) CHECK constraint failed: proxy [SQL: 'INSERT INTO proxy (ip, hostname, port, proto, username, password, online, status, checked_at, created_at, city, region, country, loc, org, postal) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)'] [parameters: ('proxuser', None, 'freeuse', '87.56.88.229:1071', '', '', None, None, None, '2017-08-14 16:30:52.673639', None, None, None, None, None, None)]

Should I install & set a Mysql database ?

mlifemaker avatar Aug 14 '17 16:08 mlifemaker

Did you specified proxy type like http? http 87.56.88.229:1071 proxuser:freeuse ?

VeeeneX avatar Aug 15 '17 06:08 VeeeneX

no I just specified this: 87.56.88.229:1071 proxuser:freeuse

maybe this is the problem. I will test.

mlifemaker avatar Aug 15 '17 09:08 mlifemaker

by adding http is doesn't work.
proxy:port user:pass is the good format. I think there is a problem while inserting the proxy info to the database.

mlifemaker avatar Aug 15 '17 09:08 mlifemaker