multimodal-learning topic

A curated list of Multimodal Related Research.

Eurus-Holmes

[ICCV 2021 Oral + TPAMI] Just Ask: Learning to Answer Questions from Millions of Narrated Videos

antoyang

[CVPR 2022 Oral] TubeDETR: Spatio-Temporal Video Grounding with Transformers

antoyang

Source code for training Gated Multimodal Units on MM-IMDb dataset

johnarevalo

Official Pytorch implementation of "OmniNet: A unified architecture for multi-modal multi-task learning" | Authors: Subhojeet Pramanik, Priyanka Agrawal, Aman Hussain

subho406

Reading list for research topics in multimodal machine learning

pliang279

A Comparative Framework for Multimodal Recommender Systems

PreferredAI

Knowledge-Aware machine LEarning (KALE): accessible machine learning from multiple sources for interdisciplinary research, part of the 🔥PyTorch ecosystem. ⭐ Star to support our work!

pykale

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

ArrowLuo

A curated list of awesome vision and language resources (still under construction... stay tuned!)

sangminwoo