mamba icon indicating copy to clipboard operation
mamba copied to clipboard

Issue about the FLOPs of selective scan

Open Aristo23333 opened this issue 6 months ago • 0 comments

Hi author! Thanks for your brilliant work first. I try to calculate the flops of mamba through calculate_flops from calflops library. I am wondering if the efficiency of selective scan can change when the sequence has more 0 or in other word more sparse. Will more sparse sequence may lead Flops smaller?I cannot test if from the calflops. Thank you!

Aristo23333 avatar Aug 22 '24 06:08 Aristo23333