pliers icon indicating copy to clipboard operation
pliers copied to clipboard

Implement FaceNet clustering extractor

Open adelavega opened this issue 3 years ago • 1 comments

In the past we used FaceNet to extract emebeddings from faces and then cluster them using the "chinese whipers" algoritm.

Unfortunately, it required substantial hand tuning to find the correct parameters..

It's possible using UMAP and HDBSCAN algorithsm (like this for document: https://towardsdatascience.com/topic-modeling-with-bert-779f7db187e6), would make this process more automatable, and possibly could implement as a single pliers Extractor.

adelavega avatar Oct 26 '22 01:10 adelavega

Some people have tried this already; https://github.com/act-labs/video_facenet

adelavega avatar Oct 26 '22 01:10 adelavega