lora-instruct icon indicating copy to clipboard operation
lora-instruct copied to clipboard

Published 20 hours ago • verified publisher icon leehanchung

Falcon -7B training loss not reducing

Open pcvishak opened this issue 8 months ago • 0 comments

Thanks for the wonderful code. While training Falcon-7B on Alpaca dataset, the training loss is not reducing. It used to work fine. Were there any recent changes?

pcvishak avatar Oct 11 '23 13:10 pcvishak