Jarvis icon indicating copy to clipboard operation
Jarvis copied to clipboard

New Feature - Image search using captions

Open qwireq opened this issue 5 years ago • 2 comments

The idea is to create captions for images in the given directory. This could be an interesting feature for Personal Assistant. Additionally, in the future, it also could be transformed into a search of images by a given description. Most images are stored with names, which are not connected with objects depicted on them. Therefore, it could be very useful functionality.

I am planning to use a pre-trained deep learning model for image captioning. Of course, some of the captions could be complete nonsense, which could affect the accuracy of the search. However, still, the rest would be appropriate. If these features are interesting for you, I could proceed to development. Thanks.

qwireq avatar Mar 21 '19 11:03 qwireq

What deep learning model do you plan to use?

madhavkulkarni1986 avatar Mar 22 '19 18:03 madhavkulkarni1986

What deep learning model do you plan to use?

I am planning to use the model from this tutorial.

qwireq avatar Mar 22 '19 21:03 qwireq