ReCO icon indicating copy to clipboard operation
ReCO copied to clipboard

Published 20 hours ago • verified publisher icon benywon

请问训练albert_xxlarge时超参如何设置

Open bestbzw opened this issue 4 years ago • 1 comments

您好，我在ReCo上用xx_large训练的时候发现模型的loss一直不下降，请问您的超参数是如何设置的？是否加了warmup，dropout等策略？

bestbzw avatar Dec 01 '20 04:12 bestbzw