TencentPretrain icon indicating copy to clipboard operation
TencentPretrain copied to clipboard

Published 20 hours ago • verified publisher icon Tencent

About Training log

Open BowieHsu opened this issue 1 year ago • 1 comments

截屏2023-03-14 下午3 55 05 Hi! During the process of fine-tuning Llama by following the tutorial, I only received warnings related to the scaling factor used in mixed precision training and did not receive any logs related to the training process itself. Is this normal?

BowieHsu avatar Mar 14 '23 07:03 BowieHsu

Ok, I check the code and found the report_steps variable, the log information now is available now. Is there any tutorial available for instruction fine-tuning that I can follow to implement it?

BowieHsu avatar Mar 14 '23 08:03 BowieHsu