LLaMA-Pro icon indicating copy to clipboard operation
LLaMA-Pro copied to clipboard

Published 20 hours ago • verified publisher icon TencentARC

Thanks for wonderful projects ! Why I always got the results of apparent loss of original ability?

Open hzgdeerHo opened this issue 9 months ago • 8 comments

After finetuned the llama-3-8B-instruct with the same configuration ,as the code from:https://github.com/hiyouga/LLaMA-Factory/tree/3df986c6793a51ec2cb5f31fd1808cd3a9883bc4/examples/extrasexamples/extras/llama_pro always leads to apparent loss of original ability? I only used the train datasets "Identity". Can you help? THANKS

hzgdeerHo avatar May 17 '24 14:05 hzgdeerHo