Zhangchen Xu issues

Repositories
Issues
Comments

Results 1 issues of


                                            Zhangchen Xu

Different training losses when flash_attention is on/off

### Please check that this issue hasn't been reported before. - [X] I searched previous [Bug Reports](https://github.com/axolotl-ai-cloud/axolotl/labels/bug) didn't find any similar reports. ### Expected Behavior Flash attention should not make...

bug

wip