TankNee

Results 12 issues of TankNee

#### 问题描述: 在微调InternLM XComposer过程中,遇到了如下报错信息。报错指出期望的标量类型为Float,但实际找到的是BFloat16。不使用DeepSpeed直接使用python运行无报错 #### 报错位置及代码片段: ```python {'loss': 14.9467, 'grad_norm': 94.78041076660156, 'learning_rate': 7.692307692307693e-05, 'epoch': 0.0} {'loss': 15.5564, 'grad_norm': 89.43864440917969, 'learning_rate': 0.00015384615384615385, 'epoch': 0.0} 0%|▏ | 2/1250 [01:05

### System Info ```shell optimum habana 1.18.0.dev0 transformers 4.49.0 habana 1.17 ``` ### Information - [ ] The official example scripts - [x] My own modified scripts ### Tasks -...

bug