multimodal-deep-learning topic

Code accompanying our ECCV-2020 paper on 3D Neural Listeners.

referit3d

Recent Advances in Vision and Language Pre-training (VLP)

phellonchen

Robust multimodal integration method implemented in PyTorch and TensorFlow

idearibosome

Source code for "MusCaps: Generating Captions for Music Audio" (IJCNN 2021)

ilaria-manco

As a part of HAKE project (HAKE-3D). Code for our CVPR2020 paper "Detailed 2D-3D Joint Representation for Human-Object Interaction".

DirtyHarryLYL

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNL...

declare-lab

A Survey on multimodal learning research.

Yutong-Zhou-cv

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

akashe

LAVIS - A One-stop Library for Language-Vision Intelligence

salesforce

MultiGraphGAN for predicting multiple target graphs from a source graph using geometric deep learning.

basiralab