BERT4doc-Classification icon indicating copy to clipboard operation
BERT4doc-Classification copied to clipboard

Published 20 hours ago • verified publisher icon xuyige

Bert中的Embedding Layer

Open loxs123 opened this issue 2 years ago • 1 comments

您好，Bert当中的Embedding Layer是在Layer0之前的，他的学习率设置为Layer0乘以权重ξ（0.95）会不会更好一点？

loxs123 avatar Nov 18 '22 02:11 loxs123