DiCMoR icon indicating copy to clipboard operation
DiCMoR copied to clipboard

关于预训练权重的问题

Open gw-zhong opened this issue 11 months ago • 0 comments

您好,我想咨询一下,在使用MR=0.0进行预训练时,是不是bert和三个project_x_{l, a, v}都要参与训练?然后在丢失的情形下,把bert和三个project_x_{l, a, v}都冻结?

gw-zhong avatar Jan 16 '25 15:01 gw-zhong