LISA icon indicating copy to clipboard operation
LISA copied to clipboard

Published 20 hours ago • verified publisher icon dvlab-research

question about text_hidden_fcs

Open CoderZhangYx opened this issue 10 months ago • 0 comments

Hi, appreciate your nice work. Observed that there is no layernorm in text_hidden_fcs module and dropout rate is set to 0. Are there any experiments that support such design?

CoderZhangYx avatar Mar 28 '24 11:03 CoderZhangYx