fotema icon indicating copy to clipboard operation
fotema copied to clipboard

Similarity search feature

Open NelvinBHV opened this issue 1 year ago • 3 comments

I would be pleased if fotema could receive a similarity search feature. Similar images and videos could then be grouped by keywords, such as mountains, beach, etc. It seems that OpenCV already offers this functionality.

NelvinBHV avatar Sep 27 '24 03:09 NelvinBHV

Hi @NelvinBHV. Yes, I'd very much like a feature like this. I've looked into the Hugging Face Candle options for similar features to this and think it could be a candidate (thought it is more object detection, than scene detection).

blissd avatar Sep 27 '24 04:09 blissd

I'm glad to hear that! I'm looking forward to seeing your implementation. Personally, I would prefer OpenCV since you've already integrated it for facial recognition.

NelvinBHV avatar Sep 27 '24 05:09 NelvinBHV

I think OpenCV is a good library, and without it I think I would have found person recognition much harder to implement. But... I would really like the libraries used by Fotema to be native Rust, rather than C++. My reason for this is reliability, as I've already experienced some crashes from other C/C++ libraries that Fotema uses through Rust bindings.

Having said that, I initially tried to use the Hugging Face Candle libraries for the face recognition and person recognition feature... but I found it too low level and complicated to easily work with :disappointed:, so OpenCV might be the solution after all.

blissd avatar Sep 27 '24 05:09 blissd