xmyu28 comments

Repositories
Issues
Comments

Results 14 comments of


                                            xmyu28

[BUG] 多卡微调遇到sigkill 无报错退出

deepspeed 0.14.2 transformers 4.40.0. torch 2.1.2 torchvision 0.16.2

自定义数据集微调internlm2_5_7b_chat注意力shape报错

02/27 03:06:07 - mmengine - INFO - before_train in EvaluateChatHook. hidden s, am torch.Size([1, 40, 4096]) torch.Size([1, 1, 40, 40]) shape torch.Size([1, 1, 40, 40]) torch.Size([1, 32, 40, 40]) torch.Size([1,...

Couldn't find plip/wiki_dev as the validation dataset

same error, have you solved it yet?