Knover icon indicating copy to clipboard operation
Knover copied to clipboard

Published 20 hours ago • verified publisher icon PaddlePaddle

bow_loss下不去，不知道怎么回事

Open tang-ed opened this issue 3 years ago • 3 comments

tang-ed avatar Oct 27 '21 06:10 tang-ed

bow_loss稳定在2左右，一直下不去

tang-ed avatar Oct 27 '21 06:10 tang-ed

lm_loss都下到0.001左右了

tang-ed avatar Oct 27 '21 06:10 tang-ed

bow loss根据公式，最低值也不是0，因为会同时拟合多个 token

sserdoubleh avatar Oct 28 '21 15:10 sserdoubleh