visual-instruction-tuning topic

List visual-instruction-tuning repositories

Awesome-Multimodal-Large-Language-Models

9.7k
Stars
631
Forks
208
Watchers

:sparkles::sparkles:Latest Papers and Datasets on Multimodal Large Language Models, and Their Evaluation.

Osprey

701
Stars
40
Forks
Watchers

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

polite-flamingo

59
Stars
3
Forks
Watchers

🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)

LSTP-Chat

17
Stars
1
Forks
Watchers

A Video Chat Agent with Temporal Prior

DataOptim

68
Stars
3
Forks
Watchers

A collection of visual instruction tuning datasets.