pytorch-vsumm-reinforce
pytorch-vsumm-reinforce copied to clipboard
Unsupervised learning use my own data
If I want to use my own dataset, but there is no features or labels in the dataset, only some video clips. How to extract features before construct the h5 file, and what should I do with user_summary, gts_score and gtsummary when construct h5 file?
@MuziSakura were you able to do it on your own dataset?
Did anyone managed to test on own data?
@cipher009 i managed to did it on my own data but the result was more like a video which was fast forwaded. It did manage to convert a 10 min long video to just 30 seconds.
This link might help you: https://medium.com/@shrutijadon10104776/video-summarization-an-survey-of-existing-algorithms-10b92a53e0a8
Thank you @syedimad1998, I will take a look. Which of the 5 methods did you use?
@cipher009 4th worked for me pretty well, also look on the first and the last too. Feel free to mail me if there are any issues.
@cipher009 4th worked for me pretty well, also look on the first and the last too. Feel free to mail me if there are any issues.
@syedimad1998 Hi, is it convenient to ask you some questions?
I implemented the project.We are using user summary,gtsummary and gtscore just to evaluate the model.You can develop the model in a fully unsupervised way. I implemented this project and you can take a look https://github.com/anaghazachariah/video_summary_generaton