icrawler
icrawler copied to clipboard
hellock
A multi-thread crawler framework with many builtin image crawlers provided.
How can we search with an input image and return similar images?
Hello everyone, I was wondering if there is a way to get some metadata at to when pictures where uploaded after crawling them. I need this kind of information for...
It would be great to have Duck Duck Go implemented within the icrawler framework. I created my own script, based upon other code (attribution provided below). My code does not...
I have a simple UI in `Tkinter`, which fixes several issues, *WITHOUT* changing the core library. If you are interested, it does show some interesting things you can do with...
* add signal for "exceed_storage_space" * fix try block logic
**When searching for images using GoogleImageCrawler, I always get an error message even though I have limited the search to 100 images. Does anyone have a solution for this problem?**...
I want know library like this use worker for google search ? Thanks u @hellock
Hey! I'm using GoogleImageCrawler and trying to turn the INFO logs off, so I see only warning and errors in cmd. Am I doing something wrong? Cause INFO logs are...
``` bing_crawler = BingImageCrawler(storage={'root_dir': 'imgs'}) bing_crawler.crawl(keyword='cat', filters=None, offset=0, max_num=100) ``` On running the above code, I am getting this error File "C:\Users\dell\.conda\envs\DataCollection\lib\threading.py", line 953, in run self._target(*self._args, **self._kwargs) File "C:\Users\dell\.conda\envs\DataCollection\lib\site-packages\icrawler\parser.py",...
