JIAHELU issues

Repositories
Issues
Comments

Results 2 issues of


                                            JIAHELU

AttributeError: 'LlamaAttention' object has no attribute 'rope_theta'

High MSE Loss after 100 epoch (even higher than begaining)

Hello author, thank you very much for your work. However, I encountered some issues during training. The MSE Loss fluctuates repeatedly during training, and it did not decrease to a...