multimodal-learning topic
mmtm
Implementation of CVPR 2020 paper "MMTM: Multimodal Transfer Module for CNN Fusion"
Learning2Dance_CAG_2020
PyTorch implementation of our graph convolutional network (GCN) for human motion generation from music. Also with paired dance-music data for training!
MFN
[AAAI 2018] Memory Fusion Network for Multi-view Sequential Learning
BaiDuBigData19-URFC
my solution with 0.67 accuracy
factorized
[ICLR 2019] Learning Factorized Multimodal Representations
Multimodal-action-recognition
Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.
bipolar-disorder
Multimodal Deep Learning Framework for Mental Disorder Recognition @ FG'20
Cross-modal-retrieval
媒体计算实践作业:图像——文本跨模态搜索
mmae
Package for Multimodal Autoencoders in TensorFlow / Keras
EgoPAT3D
[CVPR 2022] Egocentric Action Target Prediction in 3D