LMOps icon indicating copy to clipboard operation
LMOps copied to clipboard

Published 20 hours ago • verified publisher icon microsoft

[MiniLLM] llama3-instruct版本蒸馏

Open Yjonben opened this issue 7 months ago • 1 comments

我如果想在dolly数据集上进行teacher：llama3-70b-instruct，student：llama3-8b-instruct。的蒸馏，是否需要修改某些代码逻辑或者dolly数据集的template？

Yjonben avatar Jul 11 '24 03:07 Yjonben