mamba icon indicating copy to clipboard operation
mamba copied to clipboard

Implement a "crossmamba" block for different length sequences

Open YihangChen9 opened this issue 1 year ago • 3 comments

I am trying to Implement a "crossmamba" block for different length sequences which may apply in translation or other encoder-decoder task. I had seen several implementations for 2 same length sequences.

I wonder is it pratical to implement such a block? Thanks a lot!

YihangChen9 avatar Aug 02 '24 00:08 YihangChen9

There's some discussion in #229 and #263.

altaic avatar Aug 02 '24 03:08 altaic

I have seen these discussion, but there is no solution for different length sequence, since it will occur error when during selective scan because of dimensions.

YihangChen9 avatar Aug 02 '24 09:08 YihangChen9

The length dimension of A,B,C should be same, is there any trick to implementaiton,or not yet

YihangChen9 avatar Aug 02 '24 09:08 YihangChen9