multi-modal topic

List multi-modal repositories

OASIS

341
Stars
53
Forks
341
Watchers

Official implementation of the paper "You Only Need Adversarial Supervision for Semantic Image Synthesis" (ICLR 2021)

TSIT

274
Stars
33
Forks
Watchers

[ECCV 2020 Spotlight] A Simple and Versatile Framework for Image-to-Image Translation

Caesar.jl

180
Stars
31
Forks
Watchers

Robust robotic localization and mapping, together with NavAbility(TM). Reach out to [email protected] for help.

Multi-Modal-Transformer

211
Stars
29
Forks
Watchers

The repository collects many various multi-modal transformer architectures, including image transformer, video transformer, image-language transformer, video-language transformer and self-supervised l...

DevKit

73
Stars
12
Forks
Watchers

A Javascript library for developing modules for COBI.Bike – the perfect fusion of smartphone and bike.

IncrementalInference.jl

72
Stars
21
Forks
Watchers

Clique recycling non-Gaussian (multi-modal) factor graph solver; also see Caesar.jl.

iPerceive

59
Stars
16
Forks
Watchers

Applying Common-Sense Reasoning to Multi-Modal Dense Video Captioning and Video Question Answering | Python3 | PyTorch | CNNs | Causality | Reasoning | LSTMs | Transformers | Multi-Head Self Attention...

Audio2Head

305
Stars
55
Forks
Watchers

code for paper "Audio2Head: Audio-driven One-shot Talking-head Generation with Natural Head Motion" in the conference of IJCAI 2021

HiNet

84
Stars
20
Forks
Watchers

Code for TMI 2020 "Hi-Net: Hybrid-fusion Network for Multi-modal MR Image Synthesis"