Xhao

 i have the same error

same error

> deepspeed并行化操作如下： 1.增加deepspeed配置参数文件：ds_config_zero3.json `{ "fp16": { "enabled": "auto", "loss_scale": 0, "loss_scale_window": 1000, "initial_scale_power": 16, "hysteresis": 2, "min_loss_scale": 1 }, > > ``` > "optimizer": { > "type": "AdamW", > "params":...

> "fp16": { "enabled": "auto", "loss_scale": 0, "loss_scale_window": 1000, "initial_scale_power": 16, "hysteresis": 2, "min_loss_scale": 1 }, 如果确实不行 "enabled": true, 都试过了，还是不行，朋友fork一个吧