FD-GAN icon indicating copy to clipboard operation
FD-GAN copied to clipboard

How to use this model in my own videos?

Open cppntn opened this issue 5 years ago • 3 comments

Hello, thanks for this fantastic work. How can I use this model to recognize people in my own video? I have a detection network that detects bounding box of people, what would you recommend in order to use fd-gan to assign unique ID's to people in the video?

Thanks

cppntn avatar Jan 09 '19 14:01 cppntn

Maybe you can use the pretrained model to extract the visual features for each person image, and then cluster them into several groups by calculating the distances between each other.

yxgeee avatar Jan 10 '19 07:01 yxgeee

Thanks @yxgeee. How can I use a pretrained model just for the inference? What is the model and the weights that I should use?

MOreover, what kind of clustering algorithms would you recommend for calculating the distances between features?

cppntn avatar Jan 10 '19 10:01 cppntn

Hello @yxgeee, sorry to bother you.. How can I extract the feature from an image of a person? I mean, once I have loaded the weights on the SiameseNet class (should the weights be "best_net_E.pth"?) how can I do inference? have I to forward only the base model (resnet50) or the embed model too? Can you tell me a little more about this? A great thanks to you

cppntn avatar Jan 14 '19 09:01 cppntn