multimodal-fusion topic

List multimodal-fusion repositories

BMT

223
Stars
56
Forks
Watchers

Source code for "Bi-modal Transformer for Dense Video Captioning" (BMVC 2020)

Multimodal-Infomax

147
Stars
32
Forks
Watchers

This repository contains the official implementation code of the paper Improving Multimodal Fusion with Hierarchical Mutual Information Maximization for Multimodal Sentiment Analysis, accepted at EMNL...

Multimodal-action-recognition

70
Stars
13
Forks
Watchers

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

hfusion

44
Stars
22
Forks
Watchers

Multimodal sentiment analysis using hierarchical fusion with context modeling

MIntRec

69
Stars
12
Forks
Watchers

MIntRec: A New Dataset for Multimodal Intent Recognition (ACM MM 2022)

MalFusionFSL

25
Stars
2
Forks
Watchers

Few-Shot malware classification using fused features of static analysis and dynamic analysis (基于静态+动态分析的混合特征的小样本恶意代码分类框架)

fbc2_aij2022

16
Stars
1
Forks
Watchers

FusionBrain Challenge 2.0: creating multimodal multitask model

breast_mri_fusion

27
Stars
7
Forks
Watchers

[CVAMD 2021] "End-to-End Learning of Fused Image and Non-Image Feature for Improved Breast Cancer Classification from MRI"

M2H2-dataset

17
Stars
12
Forks
Watchers

This repository contains the dataset and baselines explained in the paper: M2H2: A Multimodal Multiparty Hindi Dataset For HumorRecognition in Conversations