Panda-70M icon indicating copy to clipboard operation
Panda-70M copied to clipboard

[CVPR 2024] Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers

Results 33 Panda-70M issues
Sort by recently updated
recently updated
newest added

Great thanks to the great contribution of your work! I have some doubts about how you collect the subtitles. Do you directly download the subtitles from the youtube website or...

I wrote a downloader using youtube-dlp, but a lot of the IPs get blocked after ~ 10K or so downloads. I'm surprised people are successfully downloading the dataset using the...

RT. As there are a large number of videos for processing, if there is an acceleration, such as multi-processing?

In the "Supplementary Material" Section E in your paper, all videos seem to be splitted into multiple different categories. How can I check the category of a video? It's not...

I've successfully run the` inference.py `program for captioning. And the results are good (almost the same as the example). ``` { "video1.mp4": "A red car is parked in a showroom...

Thanks for your impressive work! Will you release the retrieval model or the high-quality human-selected data?

I run the captioning file. `python inference.py --video-list inputs/video_list.txt --prompt-list inputs/prompt_list.txt` and encountered the following issues `/root/anaconda3/envs/panda70m_captioning/lib/python3.9/site-packages/torchvision/transforms/_functional_video.py:6: UserWarning: The 'torchvision.transforms._functional_video' module is deprecated since 0.12 and will be removed in...

![image](https://github.com/snap-research/Panda-70M/assets/97726897/eba6f53f-626c-429c-96b3-b7a40027e39a) this link won't jump as expected

As mentioned in your paper, no single caption model excels in all types of videos. This presents a significant challenge for researchers, making it crucial to have a robust baseline...

Is the following downloading log normal? Should I just ignore those WARNINGs ``` [download] 6.8% of ~ 4.44MiB at 48.65KiB/s ETA 00:35 (frag 1/36)WARNING: [youtube] YouTube said: ERROR - Precondition...