multimodality topic

multimodal social media content (text, image) classification

firojalam

Behavioral data analysis and plotting in Python.

TheChymera

Implementations of parallel tempering algorithms to augment samplers with tempering capabilities

TuringLang

streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL

roboflow

GPT4RoI: Instruction Tuning Large Language Model on Region-of-Interest

jshilong

DANCE: a deep learning library and benchmark platform for single-cell analysis

OmicsML

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"

MMMU-Benchmark

Prognostically Relevant Subtypes and Survival Prediction for Breast Cancer Based on Multimodal Genomics Data

rezacsedu

A Multi-modal Framework for Sentimental Analysis of Meme

AmbiTyga

A Python package housing a collection of deep-learning multi-modal data fusion method pipelines! From data loading, to training, to evaluation - fusilli's got you covered 🌸

florencejt