codellama icon indicating copy to clipboard operation
codellama copied to clipboard

fine-tuning CodeLlama-34b loss

Open sanipanwala opened this issue 1 year ago • 0 comments

Hello,

I'm fine-tuning using the CodeLlama-34b as a base model. During training My loss always shows me 0 with all the datasets.

Would someone be able to help me with this?

Thanks.

sanipanwala avatar Feb 06 '24 03:02 sanipanwala