vision-and-language topic

Summary about Video-to-Text datasets. This repository is part of the review paper *Bridging Vision and Language from the Video-to-Text Perspective: A Comprehensive Review*

jssprz

Repository to generate CLEVR-Dialog: A diagnostic dataset for Visual Dialog

satwikkottur

[NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

antoyang

ROSITA: Enhancing Vision-and-Language Semantic Alignments via Cross- and Intra-modal Knowledge Integration

MILVLG

[ACL 2021] Learning Relation Alignment for Calibrated Cross-modal Retrieval

lancopku

Hierarchical Universal Language Conditioned Policies

lukashermann

Official pytorch implementation of "Explore-And-Match: Bridging Proposal-Based and Proposal-Free With Transformer for Sentence Grounding in Videos"

sangminwoo

Pytorch code for ICRA'21 paper: "Hierarchical Cross-Modal Agent for Robotics Vision-and-Language Navigation"

GT-RIPL

Official PyTorch implementation of our CVPR 2022 paper: Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning

GT-RIPL

All-In-One VLM: Image + Video + Transfer to Other Languages / Domains (TPAMI 2023)

zengyan-97