BEV training problem

[twoDragonBear]

I first fork bevfusion and replace configs and mmdet3d with ddp's configs and mmdet3d. When training ddp, I encountered this error:

• RuntimeError: "ms_deform_attn_forward_cuda" not implemented for 'Half'

I try to replace the auto_fp16 in forward function with force_fp32, it can work. However, it shows a lot of time for training. I want to ask any solution for this error.