Qian Yuqiu

https://www.linkedin.com/in/qyq79/

Shenzhen, China

Results 1 comments of


                                            Qian Yuqiu

[BUG]: fp32 param and grad have different shape torch.Size([5064704]) vs torch.Size([128000]) when use lora_rank=4 at stage 1

the same issue too