multimodal topic

Implementation of CoCa, Contrastive Captioners are Image-Text Foundation Models, in Pytorch

lucidrains

A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

facebookresearch

Represent, send, store and search multimodal data

docarray

Represent, send, store and search multimodal data

docarray

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

ArrowLuo

Open-AI's DALL-E for large scale training in mesh-tensorflow.

EleutherAI

A CLI tool/python module for generating images from text using guided diffusion and CLIP from OpenAI.

afiaka87

🪩 Create Disco Diffusion artworks in one line

jina-ai

Multi-Modal Transformer for Video Retrieval

gabeur

Fusing Histology and Genomics via Deep Learning - IEEE TMI

mahmoodlab

Multi-Modal learning toolkit based on PaddlePaddle and PyTorch, supporting multiple applications such as multi-modal classification, cross-modal retrieval and image caption.

njustkmg