multimodality topic

List multimodality repositories

UniVL

330
Stars
54
Forks
Watchers

An official implementation for " UniVL: A Unified Video and Language Pre-Training Model for Multimodal Understanding and Generation"

CLIP4Clip

792
Stars
116
Forks
Watchers

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

clip-guided-diffusion

448
Stars
62
Forks
Watchers

A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

X-VLM

434
Stars
52
Forks
Watchers

X-VLM: Multi-Grained Vision Language Pre-Training (ICML 2022)

nmtpytorch

392
Stars
51
Forks
Watchers

Sequence-to-Sequence Framework in PyTorch

FEDOT

613
Stars
84
Forks
Watchers

Automated modeling and machine learning framework FEDOT

big-sleep

2.6k
Stars
305
Forks
Watchers

A simple command line tool for text to image generation, using OpenAI's CLIP and a BigGAN. Technique was originally created by https://twitter.com/advadnoun

multimodal-sentiment-analysis

313
Stars
74
Forks
Watchers

Attention-based multimodal fusion for sentiment analysis

how2-dataset

150
Stars
17
Forks
Watchers

This repository contains code and metadata of How2 dataset

fonduer

403
Stars
76
Forks
Watchers

A knowledge base construction engine for richly formatted data