joinloops
[Enhancement]: Video Summary in recommendation algorithm
Description
@dansup Since, you are working on a recommendation algorithm for the "For You" feed, I suggest that along with other factors you also generate a summary of the video using the ML model available at https://huggingface.co/onnx-community/gemma-3n-E2B-it-ONNX and consider that video summary as a key point in the algorithm.
Use-case
Gemma-3n-E2B is one of the smallest models which can generate video summary by analyzing both the video frames and the audio. Also, it is multilingual in nature and so will generate better summary than other models for videos with non-English models. Also, the quality of summary generation is quite good as compared to the size. So, using gemma3n's video summary as a key point in the algorithm will make the algorithm better.
Acknowledgements
Yes
