multimodal-learning topic

Papers, code and datasets about deep learning and multi-modal learning for video analysis

HuaizhengZhang

Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.

njustkmg

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

georgian-io

This repository contains various models targetting multimodal representation learning, multimodal fusion for downstream tasks such as multimodal sentiment analysis.

declare-lab

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning

pliang279

[ECCV'22] Official repository of paper titled "Class-agnostic Object Detection with Multi-modal Transformer".

mmaaz60

Interface for easier topic modelling.

machine-intelligence-laboratory

A PyTorch implementation of "Multimodal Generative Models for Scalable Weakly-Supervised Learning" (https://arxiv.org/abs/1802.05335)

mhw32

[CVPR 2022] Show Me What and Tell Me How: Video Synthesis via Multimodal Conditioning

snap-research

Code for the paper "VistaNet: Visual Aspect Attention Network for Multimodal Sentiment Analysis", AAAI'19

PreferredAI