ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

Published 20 hours ago • verified publisher icon hpcaitech

Colossal-LLaMA-2 : The difference between train.sh and train_sft.sh

Open yangzhipeng1108 opened this issue 5 months ago • 0 comments

🐛 Describe the bug

What is the difference between train.sh and train_sft.sh? use_neft this parameter? the loss of STF should pay attention to the answer(QA)

Environment

No response

yangzhipeng1108 avatar Mar 20 '24 02:03 yangzhipeng1108