mamba icon indicating copy to clipboard operation
mamba copied to clipboard

I guess mamba.step could be deleted if selective_scan_fn can accept ssm_state as an input param.

Open agiwave opened this issue 11 months ago • 4 comments

Maybe there are some benifit below: 1, The code could be simplier. 2, The inference could be faster. 3, The inference can accept multi-tokens in this way. There are some reference codes here. https://github.com/agiwave/Mamba/blob/main/Mamba.py

agiwave avatar Mar 10 '24 08:03 agiwave