multimodal-learning topic

List multimodal-learning repositories

mmtm

107
Stars
21
Forks
Watchers

Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"

Learning2Dance_CAG_2020

87
Stars
10
Forks
Watchers

PyTorch implementation of our graph convolutional network (GCN) for human motion generation from music. Also with paired dance-music data for training!

MFN

108
Stars
29
Forks
Watchers

[AAAI 2018] Memory Fusion Network for Multi-view Sequential Learning

factorized

63
Stars
10
Forks
Watchers

[ICLR 2019] Learning Factorized Multimodal Representations

Multimodal-action-recognition

70
Stars
13
Forks
Watchers

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

bipolar-disorder

32
Stars
11
Forks
Watchers

Multimodal Deep Learning Framework for Mental Disorder Recognition @ FG'20

Cross-modal-retrieval

32
Stars
11
Forks
Watchers

媒体计算实践作业:图像——文本跨模态搜索

mmae

18
Stars
11
Forks
Watchers

Package for Multimodal Autoencoders in TensorFlow / Keras

EgoPAT3D

28
Stars
3
Forks
Watchers

[CVPR 2022] Egocentric Action Target Prediction in 3D