multimodal topic

SDK for interacting with stability.ai APIs (e.g. stable diffusion inference)

Stability-AI

PromptKG Family: a Gallery of Prompt Learning & KG-related research works, toolkits, and paper-list.

zjunlp

🔆 📝 A reading list focused on Multimodal Emotion Recognition (MER) 👂👄 👀 💬

EvelynFan

Multimodal entity linking (MEL) aims to utilize multimodal information to map mentions to corresponding entities defined in knowledge bases. We release three MEL datasets: Weibo-MEL, Wikidata-MEL and...

seukgcode

Winner system (DAMO-NLP) of SemEval 2022 MultiCoNER shared task over 10 out of 13 tracks.

Alibaba-NLP

ADvISER is a flexible framework to encourage task-oriented dialog system research & development

DigitalPhonetics

Graph Distillation for Action Detection

google

Robust multimodal integration method implemented in PyTorch and TensorFlow

idearibosome

Multi-modal speech separation task data generation script on LRS3 data set.

JusperLee

Modality-Transferable-MER, multimodal emotion recognition model with zero-shot and few-shot abilities.

wenliangdai