mllm topic

List mllm repositories

unilm

18.7k
Stars
2.4k
Forks
300
Watchers

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

Awesome-LLM-Reasoning

1.2k
Stars
60
Forks
Watchers

Reasoning in Large Language Models: Papers and Resources, including Chain-of-Thought, Instruction-Tuning and Multimodality.

SEEChat

94
Stars
8
Forks
Watchers

Multimodal chatbot with computer vision capabilities integrated

Sight-Beyond-Text

19
Stars
1
Forks
Watchers

This repository includes the official implementation of our paper "Sight Beyond Text: Multi-Modal Training Enhances LLMs in Truthfulness and Ethics"

Awesome_Multimodel_LLM

182
Stars
14
Forks
Watchers

Awesome_Multimodel is a curated GitHub repository that provides a comprehensive collection of resources for Multimodal Large Language Models (MLLM). It covers datasets, tuning techniques, in-context l...

InternLM-XComposer

1.8k
Stars
118
Forks
Watchers

InternLM-XComposer2 is a groundbreaking vision-language large model (VLLM) excelling in free-form text-image composition and comprehension.

MobileAgent

2.3k
Stars
189
Forks
32
Watchers

Mobile-Agent: The Powerful Mobile Device Operation Assistant Family

Osprey

701
Stars
40
Forks
Watchers

[CVPR2024] The code for "Osprey: Pixel Understanding with Visual Instruction Tuning"

mPLUG-2

210
Stars
17
Forks
Watchers

mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video (ICML 2023)

OpenMLLM

18
Stars
5
Forks
Watchers

Open Source + Multilingual MLLM + Fine-tuning + Distillation + More efficient models and learning + ?