lukas Wang comments

Repositories
Issues
Comments

Results 5 comments of


                                            lukas Wang

多卡finetune launch_agent run报错

是怎么指定多卡的

Error when using BLOOMZ for reward model training

> @LiinXemmon Hi, this is caused by log(0) which will return `inf`, I think you should a very small value to difference of two sentences' reward(like 1e-7), it will help...

Multi-GPU Training

Hi, I have same problem here. For my case, during the training stage, there is an error saying that it expected all tensors to be on the same device.

Multi-GPU Training

Still got the error saying that `it expected all tensors to be on the same device.cuda:0, cuda:1`

3X slow inference on GeForce RTX 3060 after 4bit-128g quantization

Same with MOSS model here. 2X slower