MultiBench
MultiBench copied to clipboard
pliang279
[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning
Hi, I recently tried the MUJOCO PUSH dataset, but I cannot figure out the concrete meaning of the modalities. The paper mentioned > The multimodal inputs are gray-scaled images (1...
Hello. I wished to open a PR sometime to add support for the DHG-14/28 dataset [ [site](http://www-rech.telecom-lille.fr/DHGdataset/) | [paper](https://www.cv-foundation.org/openaccess/content_cvpr_2016_workshops/w21/papers/De_Smedt_Skeleton-Based_Dynamic_Hand_CVPR_2016_paper.pdf) ]. It's a challenging _dynamic hand-gesture recognition_ dataset consisting of three...
Hello, I am currently conducting some experiments on CMU-MOSI and CMU-MOSEI using mmsdk, but I would like to use MultiBench too for my research. Where can I find the sota?...
Hi, Thank you for this amazing repo. I would like to ask further information about how the MOSEI dataset was preprocessed in the released files in the affecting computing part....
In examples/affect, there are` os.environ['CUDA_VISIBLE_DEVICES'] = '0'` in some files, and this might result in an error.
The author did not mention it in requirement.txt, but after testing, you had better use torch2.0 and the torchtext of the corresponding version. 作者在requirement.txt中没有讲，但经过测试，pytorch2.0以及对应的torchtext版本是必须的。
First off, grateful for the repo and hats off to the tremendous effort that went into building this. When experimenting with one of the given examples "MultiBench/examples/multimedia/mmimdb_simple_early_fusion.py". There are multiple...
Hello, I would be interested to train an audio-only model (or, perhaps, a bimodal audio-text one) using CMU-MOSEI data. I would be recomputing the audio embeddings. So I would need...
Hi I have a question about relative robustness. There is a function of "relative_robustness_helper" in eval_scripts/robustness.py. It may be my misunderstanding, but that function is correct? I think it's necessary...
It would make it easier to import the package into my main codebose. Right now I have to add MultiBench directory to the python path in order to use it.
