multimodal-learning topic

[IEEE Transactions on Medical Imaging/TMI] This repo is the official implementation of "LViT: Language meets Vision Transformer in Medical Image Segmentation"

HUANGLIZI

Offical implementation of paper "MSAF: Multimodal Split Attention Fusion"

anita-hu

Dataset for Visually Indicated Sound Generation by Perceptually Optimized Classification

kanchen-usc

Utils and modules for Speech Language and Multimodal processing using pytorch and pytorch lightning

georgepar

An open-source framework for training large multimodal models.

mlfoundations

OFASys: A Multi-Modal Multi-Task Learning System for Building Generalist Models

OFA-Sys

[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

AILab-CVC

ICCV 2023 Papers: Discover cutting-edge research from ICCV 2023, the leading computer vision conference. Stay updated on the latest in computer vision and deep learning, with code included. ⭐ support...

DmitryRyumin

Multi-modality pre-training

microsoft

AMOS: A Large-Scale Abdominal Multi-Organ Benchmark for Versatile Medical Image Segmentation

JiYuanFeng