lichao comments

Repositories
Issues
Comments

Results 6 comments of


                                            lichao

[BUG]KeyError: 'attention_mask'

> Hi @janglichao, can you please provide more information about your setup? > > ds_report output Please run ds_report to give us details about your setup. > > System info...

[BUG]No module named 'colossalai._C.cpu_adam':

same problem, can anyone help!!!

[BUG]No module named 'colossalai._C.cpu_adam':

same problem, can anyone help!!!

Can not train llama-7b due to OOM on 40GA100

same problem!!! can official team solve this bug ASAP!!!!

commerical use

> thanks。

关掉Lora微调大模型，模型并行训练报错：Expected all tensors to be on the same device, but found at least two devices, cuda:3 and cuda:0!

我也遇到这个bug，怎么解决啊，在线蹲个方案