Jonas Schult

Cross Attention with attention_step1_v2 using differently sized key and query sets

4

Hi! Thanks for this amazing project! I'd like to use your memory-efficient imlementation of sparse attention in another project. In my project, I'd like to perform cross-attention between a query...