multimodal-deep-learning icon indicating copy to clipboard operation
multimodal-deep-learning copied to clipboard

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

Results 6 multimodal-deep-learning issues
Sort by recently updated
recently updated
newest added

hello, Can you share the script used to create the pickle files from the original data files? Thank you.

Hello, Can you share the way you extract audio features in the work "Multi-level Multiple Attentions for Contextual Multimodal Sentiment Analysis"? I have no idea that how to extract 100...

I have trained the **Context-Dependent Sentiment Analysis in User Generated Videos** , and it went well! But how can I use the model to infer new data! Thanks! @soujanyaporia

Hi how can we fit our own dataset . Are models classifying the sentiment of speaker - based on tone of speech, what they speech, with what facial expression do...

Can this model be executed using only audio and video modes? If so, how effective is it?

Hello, I am confused about how to add distributed training so that I can define gpu for training. I don't know which file should I modify and add some codes...