MambaVision icon indicating copy to clipboard operation
MambaVision copied to clipboard

Can I use mambavision on cpu?

Open kurbobo opened this issue 5 months ago • 1 comments

I have problems with run on cpu

File mamba_ssm/ops/selective_scan_interface.py:42, in SelectiveScanFn.forward(ctx, u, delta, A, B, C, D, z, delta_bias, delta_softplus, return_last_state)
     40     C = rearrange(C, "b dstate l -> b 1 dstate l")
     41     ctx.squeeze_C = True
---> 42 out, x, *rest = selective_scan_cuda.fwd(u, delta, A, B, C, D, z, delta_bias, delta_softplus)
     43 ctx.delta_softplus = delta_softplus
     44 ctx.has_z = z is not None

RuntimeError: Expected u.is_cuda() to be true, but got false.  (Could this error message be improved?  If so, please report an enhancement request to PyTorch.)

Is there any way to fix it?

kurbobo avatar Sep 28 '24 08:09 kurbobo