Peiji Li

icon company Fudan University icon location 上海市 icon location FudanNLP & Shanghai AI Lab

Results 1 comments of Peiji Li

PPOV2 Trainner use Deepspeed Zero3 Offload CPU: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cpu!

I have met the same problem with DPO + fsdp. With ZeRO3, it seems that it doen not work, the GPU memory occupation is not correct.