multimodal-large-language-models topic

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

AIDC-AI

🎉 The code repository for "Parrot: Multilingual Visual Instruction Tuning" in PyTorch.

AIDC-AI

A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, llava-onevision, llama-3.2-vision, qwen-vl, qwen2-vl, phi3-v etc.

zjysteven

Official code of "EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model"

hustvl

A multimodal chat interface with many tools.

danilop

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

ictnlp

✨✨VITA: Towards Open-Source Interactive Omni Multimodal LLM

VITA-MLLM

✨✨[CVPR 2025] Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysis

MME-Benchmarks

🔥🔥MLVU: Multi-task Long Video Understanding Benchmark

JUNJIE99

SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models

apple