AutoCrawler
AutoCrawler copied to clipboard
Click time out - //input[@type="button"] when downloading google photos
When running the script , it will try to scoll down pages for one time, but after that the error will keep happening and I can`t get any link. My Chrome version is 84.0.4147.105 and system versin is 5.6.15-1-MANJARO
+1
I couldn't reproduce your error.
But chromedriver version mismatch may produce click failing error. I updated chromedriver version from v83 to v84. I hope bug fixed.
If the error doesn't fix, please add comment. Thank you.
@YoongiKim I've also meet the same problem, and I check the chrome driver Session info: chrome=88.0.4324.96, and the driver in chrome folder is also the corresponding version
@YoongiKim
I've solved the error, I update your project, and then it runs well.but the images all download from naver instead of google, and finally also occur Click time out - //input[@type="button"], I wonder it is the reason that I can not access google browser
Downloading car from naver: 375 / 375
Done naver : car
Scrolling down
Click time out - //input[@type="button"]
Refreshing browser...
Click time out - //input[@type="button"]
by the way, the maximum picture of one class is limited(for example, I set the keyword 'car', and the download pictures is just 375)
Click fail means that program couldn't find the button's html tag. Google's html code may different in country and website keeps changing to prevent crawling.
You can check the XPATH of button in html code by using developer mode.

And change in collect_links.py
self.wait_and_click('//input[@type="button"]')
Maximum number of picture is not limited basically. the 375 means that crawler only found the 375 image links.
혹시 xpath를 추출해서 어떻게 바꾸라는 뜻이실까요?
In my case, if the keyword I use make google to give ads like this

Then the //input[@type="button"] error occur.
So i will try another variant of keyword that won't trigger google ads.
In my case, the number of images was low and there was no button to view more results, so the code below was looping infinitely. After commenting out the exception code, when elem is None, when implemented to pass, it worked normally.
If Execption continues to occur within the wait_and_click() function, the problem seems to be that the wait_and_click() function is continuously called.
Note please.