vision-and-language topic

Multimodal-GPT

open-mmlab

Positive-Augmented Contrastive Learning for Image and Video Captioning Evaluation. CVPR 2023

aimagelab

A PyTorch implementation of EmpiricalMVM

tsujuifu

A general representation model across vision, audio, language modalities. Paper: ONE-PEACE: Exploring One General Representation Model Toward Unlimited Modalities

OFA-Sys

[CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

mbzuai-oryx

[CVPR 2024] Alpha-CLIP: A CLIP Model Focusing on Wherever You Want

SunzeY

This repo lists relevant papers summarized in our survey paper: A Systematic Survey of Prompt Engineering on Vision-Language Foundation Models.

JindongGu

[TPAMI 2024] Official repo of "ETPNav: Evolving Topological Planning for Vision-Language Navigation in Continuous Environments"

MarSaKi

Evaluating Vision & Language Pretraining Models with Objects, Attributes and Relations.

om-ai-lab

showlab