cross-modal topic

DistillBEV: Boosting Multi-Camera 3D Object Detection with Cross-Modal Knowledge Distillation (ICCV 2023)

qcraftai

BioT5: Enriching Cross-modal Integration in Biology with Chemical Knowledge and Natural Language Associations (EMNLP 2023)

QizhiPei

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

zjukg

[IEEE T-IP 2021] Semantics-aware Adaptive Knowledge Distillation for Cross-modal Action Recognition

YangLiu9208

Code for paper "direct speech-to-image translation"

smallflyingpig

[Paper][AAAI 2024] Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations

zjukg

The official implementation of Achieving Cross Modal Generalization with Multimodal Unified Representation (NeurIPS '23)

haihuangcode

[CVPR2024] The code of "UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory"

Paranioar

Python implementation of cross-modal hashing algorithms

yolo2233

This repository provides a comprehensive collection of research papers focused on multimodal representation learning, all of which have been cited and discussed in the survey just accepted https://dl....

marslanm