google-images-download icon indicating copy to clipboard operation
google-images-download copied to clipboard

Published 20 hours ago • verified publisher icon hardikvasa

How to use this tool to achieve large-scale crawling

Open wxwmaple opened this issue 2 years ago • 2 comments

We need to do an image search on about 2 million words and get 5 pictures for each word. Experiments have shown that the loop will block when it climbs to a few hundred.

wxwmaple avatar Feb 24 '22 02:02 wxwmaple

Hi @wxwmaple ,

Do you have more information about the blocking ? Is it an Out Of Memory ? Do you have no results at some point ?

NicolasGrosjean avatar Feb 25 '22 20:02 NicolasGrosjean

you can use Bing Image Downloader instead. Github link - repo link

KTS-o7 avatar Feb 17 '24 06:02 KTS-o7