FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard
verified publisher icon FlagOpen

finetuning reranker large 训练过程显存攀升

Open wxl18039675170 opened this issue 2 years ago • 1 comments

为什么训练过程中显存占用会持续变大呢？

image

wxl18039675170 avatar Nov 17 '23 02:11 wxl18039675170

由于输入数据长度不一样，后面出现了更长的文本，显存是会增长的。在运行一段时间后会稳定下来

staoxiao avatar Nov 17 '23 03:11 staoxiao