multimodal-large-language-models topic

ModelScope-Agent: An agent framework connecting models in ModelScope with the world

modelscope

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

YingqingHe

A curated list of awesome Multimodal studies.

friedrichor

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

MileBench

FreeVA: Offline MLLM as Training-Free Video Assistant

whwu95

Speech, Language, Audio, Music Processing with Large Language Model

X-LANCE

Matryoshka Multimodal Models

mu-cai

DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception

baaivision

Code for the paper: GAMA: A Large Audio-Language Model with Advanced Audio Understanding and Complex Reasoning Abilities

Sreyan88

[ACL 2024] OceanGPT: A Large Language Model for Ocean Science Tasks

zjunlp