cross-attention topic

List cross-attention repositories

Multimodal-action-recognition

70
Stars
13
Forks
Watchers

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

CrossAttentionControl

1.2k
Stars
89
Forks
16
Watchers

Unofficial implementation of "Prompt-to-Prompt Image Editing with Cross Attention Control" with Stable Diffusion

unimatch

1.0k
Stars
103
Forks
Watchers

[TPAMI'23] Unifying Flow, Stereo and Depth Estimation

uform

1.0k
Stars
61
Forks
Watchers

Pocket-Sized Multimodal AI for content understanding and generation across multilingual texts, images, and 🔜 video, up to 5x faster than OpenAI CLIP and LLaVA 🖼️ & 🖋️

HRFuser

29
Stars
2
Forks
Watchers

[ITSC-2023] HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection

transformer-xl

27
Stars
3
Forks
Watchers

A lightweight PyTorch implementation of the Transformer-XL architecture proposed by Dai et al. (2019)

CALM-pytorch

135
Stars
9
Forks
Watchers

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind

attention-map

137
Stars
9
Forks
Watchers

🚀 Cross attention map tools for huggingface/diffusers

SLiMe

121
Stars
15
Forks
Watchers

1-shot image segmentation using Stable Diffusion

Energy-Based-CrossAttention

42
Stars
2
Forks
Watchers

The official repository of "Energy-Based Cross Attention for Bayesian Context Update in Text-to-Image Diffusion Models".