albert_zh icon indicating copy to clipboard operation
albert_zh copied to clipboard

Published 20 hours ago • verified publisher icon brightmart

albert tiny是怎么训练得到尼？

Open jkszw2014 opened this issue 5 years ago • 0 comments

你好请问一下tinybert的训练方式是不是直接从最原始的开始训练呢？还是从大模型distill到小模型呢？

jkszw2014 avatar Dec 11 '19 14:12 jkszw2014