multimodal-representation topic

List multimodal-representation repositories

FVTA_MemexQA

33
Stars
15
Forks
Watchers

Real-world photo sequence question answering system (MemexQA). CVPR'18 and TPAMI'19

cornac

831
Stars
134
Forks
Watchers

A Comparative Framework for Multimodal Recommender Systems

BERT-like-is-All-You-Need

111
Stars
10
Forks
Watchers

The code for our INTERSPEECH 2020 paper - Jointly Fine-Tuning "BERT-like'" Self Supervised Models to Improve Multimodal Speech Emotion Recognition

BBFN

61
Stars
14
Forks
Watchers

This repository contains the implementation of the paper -- Bi-Bimodal Modality Fusion for Correlation-Controlled Multimodal Sentiment Analysis

mica-deep-mcca

31
Stars
14
Forks
Watchers

Deep Multiset Canonical Correlation Analysis - An extension of CCA to multiple datasets

pyWikiMM

15
Stars
2
Forks
Watchers

Collects a multimodal dataset of Wikipedia articles and their images

IISAN

22
Stars
0
Forks
Watchers

IISAN: Efficiently Adapting Multimodal Representation for Sequential Recommendation with Decoupled PEFT