AutoCrawler icon indicating copy to clipboard operation
AutoCrawler copied to clipboard

Click time out - //input[@type="button"] when downloading google photos

Open ShiratsuyuClassYuudachi opened this issue 5 years ago • 8 comments

When running the script , it will try to scoll down pages for one time, but after that the error will keep happening and I can`t get any link. My Chrome version is 84.0.4147.105 and system versin is 5.6.15-1-MANJARO

ShiratsuyuClassYuudachi avatar Aug 09 '20 14:08 ShiratsuyuClassYuudachi

+1

yunkchen avatar Aug 10 '20 08:08 yunkchen

I couldn't reproduce your error.

But chromedriver version mismatch may produce click failing error. I updated chromedriver version from v83 to v84. I hope bug fixed.

If the error doesn't fix, please add comment. Thank you.

YoongiKim avatar Aug 18 '20 15:08 YoongiKim

@YoongiKim I've also meet the same problem, and I check the chrome driver Session info: chrome=88.0.4324.96, and the driver in chrome folder is also the corresponding version

cs-heibao avatar Jan 23 '21 12:01 cs-heibao

@YoongiKim I've solved the error, I update your project, and then it runs well.but the images all download from naver instead of google, and finally also occur Click time out - //input[@type="button"], I wonder it is the reason that I can not access google browser

Downloading car from naver: 375 / 375
Done naver : car
Scrolling down
Click time out - //input[@type="button"]
Refreshing browser...
Click time out - //input[@type="button"]

by the way, the maximum picture of one class is limited(for example, I set the keyword 'car', and the download pictures is just 375)

cs-heibao avatar Jan 23 '21 12:01 cs-heibao

Click fail means that program couldn't find the button's html tag. Google's html code may different in country and website keeps changing to prevent crawling.

You can check the XPATH of button in html code by using developer mode. image

And change in collect_links.py self.wait_and_click('//input[@type="button"]')

Maximum number of picture is not limited basically. the 375 means that crawler only found the 375 image links.

YoongiKim avatar Jan 23 '21 14:01 YoongiKim

혹시 xpath를 추출해서 어떻게 바꾸라는 뜻이실까요?

jagwoo12 avatar Sep 10 '21 15:09 jagwoo12

In my case, if the keyword I use make google to give ads like this image

Then the //input[@type="button"] error occur.

So i will try another variant of keyword that won't trigger google ads.

vinson2233 avatar Sep 21 '21 02:09 vinson2233

In my case, the number of images was low and there was no button to view more results, so the code below was looping infinitely. After commenting out the exception code, when elem is None, when implemented to pass, it worked normally.

If Execption continues to occur within the wait_and_click() function, the problem seems to be that the wait_and_click() function is continuously called.

image

image

Note please.

22ema avatar Jul 04 '23 05:07 22ema