cross-modal topic

List cross-modal repositories

awesome-audio-visual

622
Stars
70
Forks
Watchers

A curated list of different papers and datasets in various areas of audio-visual processing

SCAN

527
Stars
111
Forks
Watchers

PyTorch source code for "Stacked Cross Attention for Image-Text Matching" (ECCV 2018)

knowledge-graphs

1.6k
Stars
288
Forks
Watchers

A collection of research on knowledge graphs

erlexec

2.8k
Stars
222
Forks
Watchers

Represent, send, store and search multimodal data

docarray

2.8k
Stars
222
Forks
Watchers

Represent, send, store and search multimodal data

discoart

3.8k
Stars
246
Forks
27
Watchers

🪩 Create Disco Diffusion artworks in one line

Weakly-Supervised-3D-Object-Detection

101
Stars
17
Forks
Watchers

Weakly Supervised 3D Object Detection from Point Clouds (VS3D), ACM MM 2020

objects-that-sound

82
Stars
16
Forks
Watchers

Unofficial Implementation of Google Deepmind's paper `Objects that Sound`

MoTIS

116
Stars
10
Forks
Watchers

[NAACL 2022]Mobile Text-to-Image search powered by multimodal semantic representation models(e.g., OpenAI's CLIP)

DSRAN

68
Stars
12
Forks
Watchers

Code for journal paper "Learning Dual Semantic Relations with Graph Attention for Image-Text Matching", TCSVT, 2020.

ml-CCA

19
Stars
3
Forks
Watchers

Implementation of Fast ml-CCA from the ICCV-2015 work "Multi-Label Cross-Modal Retrieval"