autotrain-advanced icon indicating copy to clipboard operation
autotrain-advanced copied to clipboard

[BUG] Any updates to errors due to Gradient Accumulation?

Open jackswl opened this issue 4 months ago • 0 comments

Prerequisites

  • [X] I have read the documentation.
  • [X] I have checked other issues for similar problems.

Backend

Local

Interface Used

CLI

CLI Command

UI Screenshots & Parameters

Error Logs

With the recent bug fix by Unsloth, wondering if AutoTrain will be updated for this? Thanks https://www.reddit.com/r/LocalLLaMA/comments/1g4ego7/llm_training_bug_fixes_gradient_accumulation_was/

Additional Information

No response

jackswl avatar Oct 17 '24 02:10 jackswl