autotrain-advanced
autotrain-advanced copied to clipboard
[BUG] Any updates to errors due to Gradient Accumulation?
Prerequisites
- [X] I have read the documentation.
- [X] I have checked other issues for similar problems.
Backend
Local
Interface Used
CLI
CLI Command
UI Screenshots & Parameters
Error Logs
With the recent bug fix by Unsloth, wondering if AutoTrain will be updated for this? Thanks https://www.reddit.com/r/LocalLLaMA/comments/1g4ego7/llm_training_bug_fixes_gradient_accumulation_was/
Additional Information
No response