AutoCrawler
AutoCrawler copied to clipboard
YoongiKim
Google, Naver multiprocess image web crawler (Selenium)
Detected OS : Windows Detected OS : Windows Error occurred while initializing chromedriver - HTTPSConnectionPool(host='chromedriver.storage.googleapis.com', port=443): Max retries exceeded with url: /103.0.5060/chromedriver_win32.zip (Caused by ProxyError('Cannot connect to proxy.', OSError(0, 'Error')))...
Hello, I am crawling using keywords in various languages, and your repo has been a tremendous help! The code worked perfectly until last week and I could get 100s ~...
Excuse me, I saw that your code has been updated, and I re-use python main.py --full true now, but it produces thumbnails instead of full images.   
`(Minseok) ubuntu@DESKTOP-SMIU2JP:~/anaconda3/envs/Minseok/Portfolio/TeamProject/AutoCrawler-master$ Xvfb :99 -ac & DISPLAY=:99 python3 main.py [1] 18306 (EE) Fatal server error: (EE) Server is already active for display 99 If this server is no longer running,...
Download failed - check_hostname requires server_hostname Downloading cat from google: 1 / 700 Download failed - check_hostname requires server_hostname Downloading cat from google: 1 / 700 Download failed - check_hostname...
When running the script , it will try to scoll down pages for one time, but after that the error will keep happening and I can`t get any link. My...
Hello, I can download thumbnails using `python main.py`, but can’t download with parameter `python main.py --full true`.Please help me, thanks！ 
This project is awesome. But how could I download only limted number of images, since only images that on the first page is most important.
I set the 'full_resolution=True'. The resolutions of images are still very small. How to obtain the high quality images.
Hello, i used mode --full true --no_gui true/false but most downloaded images is low-resolution And most paths look like "https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9...." 
