Can I use mambavision on cpu?

[kurbobo]

I have problems with run on cpu

File mamba_ssm/ops/selective_scan_interface.py:42, in SelectiveScanFn.forward(ctx, u, delta, A, B, C, D, z, delta_bias, delta_softplus, return_last_state)
     40     C = rearrange(C, "b dstate l -> b 1 dstate l")
     41     ctx.squeeze_C = True
---> 42 out, x, *rest = selective_scan_cuda.fwd(u, delta, A, B, C, D, z, delta_bias, delta_softplus)
     43 ctx.delta_softplus = delta_softplus
     44 ctx.has_z = z is not None

RuntimeError: Expected u.is_cuda() to be true, but got false.  (Could this error message be improved?  If so, please report an enhancement request to PyTorch.)

Is there any way to fix it?

[ahatamiz]

Hi @kurbobo

The selective_scan operation in Mamba is implemented for CUDA. There's a related issue here, but I don't believe CPU inference is yet fully supported.

Hope this helps !