pytorch-vsumm-reinforce icon indicating copy to clipboard operation
pytorch-vsumm-reinforce copied to clipboard

Unsupervised learning use my own data

Open MuziSakura opened this issue 5 years ago • 7 comments

If I want to use my own dataset, but there is no features or labels in the dataset, only some video clips. How to extract features before construct the h5 file, and what should I do with user_summary, gts_score and gtsummary when construct h5 file?

MuziSakura avatar Nov 06 '18 05:11 MuziSakura

@MuziSakura were you able to do it on your own dataset?

Datartic avatar Jun 17 '19 12:06 Datartic

Did anyone managed to test on own data?

cipher009 avatar Jul 18 '19 08:07 cipher009

@cipher009 i managed to did it on my own data but the result was more like a video which was fast forwaded. It did manage to convert a 10 min long video to just 30 seconds.

This link might help you: https://medium.com/@shrutijadon10104776/video-summarization-an-survey-of-existing-algorithms-10b92a53e0a8

Datartic avatar Jul 18 '19 14:07 Datartic

Thank you @syedimad1998, I will take a look. Which of the 5 methods did you use?

cipher009 avatar Jul 18 '19 14:07 cipher009

@cipher009 4th worked for me pretty well, also look on the first and the last too. Feel free to mail me if there are any issues.

Datartic avatar Jul 18 '19 14:07 Datartic

@cipher009 4th worked for me pretty well, also look on the first and the last too. Feel free to mail me if there are any issues.

@syedimad1998 Hi, is it convenient to ask you some questions?

Tramac avatar Aug 23 '19 02:08 Tramac

I implemented the project.We are using user summary,gtsummary and gtscore just to evaluate the model.You can develop the model in a fully unsupervised way. I implemented this project and you can take a look https://github.com/anaghazachariah/video_summary_generaton

anaghazachariah avatar Sep 16 '20 06:09 anaghazachariah