visual-language-learning topic

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

haotian-liu

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Luodian

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

mlpc-ucsd

Docker image for LLaVA: Large Language and Vision Assistant

ashleykleynhans

Code and models for NExT-GPT: Any-to-Any Multimodal Large Language Model

NExT-GPT

InternLM-XComposer-2.5: A Versatile Large Vision Language Model Supporting Long-Contextual Input and Output

InternLM

[CVPR'24] RLHF-V: Towards Trustworthy MLLMs via Behavior Alignment from Fine-grained Correctional Human Feedback

RLHF-V

🧘🏻‍♂️KarmaVLM (相生)：A family of high efficiency and powerful visual language model.

thomas-yanxin

An open-source implementation for training LLaVA-NeXT.

xiaoachen98

Multimodal Instruction Tuning for Llama 3

AdrianBZG