multimodality topic

The Cradle framework is a first attempt at General Computer Control (GCC). Cradle supports agents to ace any computer task by enabling strong reasoning abilities, self-improvment, and skill curation,...

BAAI-Agents

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

MMStar-Benchmark

[CVPR2024] Generative Region-Language Pretraining for Open-Ended Object Detection

FoundationVision

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

YingqingHe

Collects a multimodal dataset of Wikipedia articles and their images

OlehOnyshchak

This repo contains evaluation code for the paper "MileBench: Benchmarking MLLMs in Long Context"

MileBench

A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

AIDC-AI

Code associated with the EMNLP 2024 Main paper: "Image, tell me your story!" Predicting the original meta-context of visual misinformation.

UKPLab