BalloutAI

How is the fine-tuning performed?

1

How is the fine-tuning performed? Is the whole model frozen with only the head being trained? or is all of the parameters trained ?

I am looking at the files inside llm folder of anli1, the val_cot_0 has more than 1400 samples (I looked the number of "so the answer is" in the file)...