howto100m
howto100m copied to clipboard
antoine77340
Code for the HowTo100M paper
Why “Learning a Text-Video Embedding from Incomplete and Heterogeneous Data” and “HowTo100M: Learning a Text-Video Embedding by Watching Hundred Million Narrated Video Clips” evaluation protocol different? Is there a test...
When loading the pre-extracted features (using Antoine's FE script), I'm running into an issue with your exact dataloader. Namely, the error thrown is ``` AttributeError: 'numpy.ndarray' object has no attribute...
1. There is always a time overlap between two neighboring video chunks (e.g. [5.61,7.9] and [7.9,13.84]), but there is no common overlap word between two neighboring text chunks, why ?...
Embd_dim
Hi, thank you for sharing the model. For the evaluation the line suggest to use 6144 for the embedding: python eval.py --eval_msrvtt=1 --eval_youcook=1 --eval_lsmdc=1 --num_thread_reader=8 --embd_dim=6144 --pretrain_path=model/howto100m_pt_model.pth. Is that indeed...
It seems that in your training/eval data there is only one 2048 2d feature and one 2048 3d feature for a sentence. But using the feature extractor in https://github.com/antoine77340/video_feature_extractor ,...
Hi, I have been trying to read the file caption.pickle of the zip folder HowTo100M.zip which according to the documentation contains the captions per video. I am using python3 and...
Thanks for sharing this awesome work ! However, I failed to download the model `resnet152-b121ed2d.pth` from the server: `You don't have permission to access /cluster-willow/amiech/howto100m/models/resnet152-b121ed2d.pth on this server.` Were there...
I had sent a request form to download the dataset multiple times by now, but never got a response. Is the form still maintained and the download of the videos...
The search at https://www.di.ens.fr/willow/research/howto100m/ errors out with the following error. Please fix. 404 Not Found Unexpected query string parameters: search Traceback (most recent call last): File "/home/ROCQ/sed/praverdy/miniconda3/envs/howto100m/lib/python3.8/site-packages/cherrypy/_cpdispatch.py", line 54, in...
