grounding topic

List grounding repositories

Grounding_LLMs_with_online_RL

200
Stars
20
Forks
Watchers

We perform functional grounding of LLMs' knowledge in BabyAI-Text

hulc2

30
Stars
2
Forks
Watchers

[ICRA2023] Grounding Language with Visual Affordances over Unstructured Data

lumos

440
Stars
28
Forks
Watchers

Code and data for "Lumos: Learning Agents with Unified Data, Modular Design, and Open-Source LLMs"

Video-LLaVA

238
Stars
11
Forks
Watchers

PG-Video-LLaVA: Pixel Grounding in Large Multimodal Video Models

DUET

41
Stars
8
Forks
Watchers

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

LAR-Look-Around-and-Refer

26
Stars
2
Forks
Watchers

This is the official implementation for our paper;"LAR:Look Around and Refer".

Cradle

1.8k
Stars
160
Forks
21
Watchers

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation,...

Groma

543
Stars
57
Forks
Watchers

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

CLIP-VG

107
Stars
6
Forks
Watchers

[TMM 2023] Self-paced Curriculum Adapting of CLIP for Visual Grounding.

SelfEQ

20
Stars
1
Forks
Watchers

[CVPR 2024] Code for "Improved Visual Grounding through Self-Consistent Explanations".