multi-modal-fusion topic

List multi-modal-fusion repositories

Multi-Modal-Image-Fusion

25
Stars
6
Forks
Watchers

Training for multi-modal image fusion with PyTorch.

Achelous

140
Stars
9
Forks
Watchers

Achelous: A Fast Unified Water-surface Panoptic Perception Framework based on Fusion of Monocular Camera and 4D mmWave Radar

the-compiler

144
Stars
19
Forks
Watchers

Seed, Code, Harvest: Grow Your Own App with Tree of Thoughts!

Husformer

104
Stars
30
Forks
Watchers

This repository contains the source code for our paper: "Husformer: A Multi-Modal Transformer for Multi-Modal Human State Recognition". For more details, please refer to our paper at https://arxiv.org...

MegaVIT

25
Stars
1
Forks
Watchers

The open source implementation of the model from "Scaling Vision Transformers to 22 Billion Parameters"

VisEvent_SOT_Benchmark

121
Stars
9
Forks
Watchers

[IEEE TCYB 2023] The first large-scale tracking dataset by fusing RGB and Event cameras.

ACMVH

23
Stars
0
Forks
Watchers

Adaptive Confidence Multi-View Hashing

MoE-Mamba

69
Stars
2
Forks
Watchers

Implementation of MoE Mamba from the paper: "MoE-Mamba: Efficient Selective State Space Models with Mixture of Experts" in Pytorch and Zeta

AM3Net_Multimodal_Data_Fusion

31
Stars
3
Forks
Watchers

Code for J. Wang, J. Li, Y. Shi, J. Lai and X. Tan, "AM3Net: Adaptive Mutual-learning-based Multimodal Data Fusion Network," in IEEE TCSVT, 2022. We conducted the experiments on the hyperspectral and...

KG-MM-Survey

242
Stars
13
Forks
Watchers

Knowledge Graphs Meet Multi-Modal Learning: A Comprehensive Survey