multi-modal topic

List multi-modal repositories

OASIS

319
Stars
56
Forks
Watchers

Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)

TSIT

274
Stars
33
Forks
Watchers

[ECCV 2020 Spotlight] A Simple and Versatile Framework for Image-to-Image Translation

Caesar.jl

180
Stars
31
Forks
Watchers

Robust robotic localization and mapping, together with NavAbility(TM). Reach out to [email protected] for help.

Multi-Modal-Transformer

211
Stars
29
Forks
Watchers

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised l...

DevKit

73
Stars
12
Forks
Watchers

A Javascript library for developing modules for COBI.Bike – the perfect fusion of smartphone and bike.

IncrementalInference.jl

72
Stars
21
Forks
Watchers

Clique recycling non-Gaussian (multi-modal) factor graph solver; also see Caesar.jl.

iPerceive

59
Stars
16
Forks
Watchers

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention...

Audio2Head

305
Stars
55
Forks
Watchers

code for paper "Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion" in the conference of IJCAI 2021

HiNet

84
Stars
20
Forks
Watchers

Code for TMI 2020 "Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis"