multimodality topic

multimodal social media content (text, image) classification

firojalam

Behavioral data analysis and plotting in Python.

TheChymera

Implementations of parallel tempering algorithms to augment samplers with tempering capabilities

TuringLang

Effective prompting for Large Multimodal Models like GPT-4 Vision, LLaVA or CogVLM. 🔥

roboflow

GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

jshilong

DANCE: a deep learning library and benchmark platform for single-cell analysis

OmicsML

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

MMMU-Benchmark

Prognostically Relevant Subtypes and Survival Prediction for Breast Cancer Based on Multimodal Genomics Data

rezacsedu

A Multi-modal Framework for Sentimental Analysis of Meme

AmbiTyga

A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸

florencejt