visual-instruction-tuning topic

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

BradyFU

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

CircleRadon

🦩 Visual Instruction Tuning with Polite Flamingo - training multi-modal LLMs to be both clever and polite! (AAAI-24 Oral)

ChenDelong1999

[EMNLP 2024] A Video Chat Agent with Temporal Prior

bigai-nlco

A collection of visual instruction tuning datasets.

BAAI-DCAI

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.

zjysteven

LLaVA-Mini is a unified large multimodal model (LMM) that can support the understanding of images, high-resolution images, and videos in an efficient manner.

ictnlp