ImageReward icon indicating copy to clipboard operation
ImageReward copied to clipboard
verified publisher icon THUDM

训练问题

Open zshuo7615 opened this issue 1 year ago • 1 comments

采用的内存50GB的3090进行单gpu训练，批次设置为1但是依旧出现显存不足的情况，有解决方案吗

zshuo7615 avatar May 17 '24 00:05 zshuo7615

可以减少Transformer参数的可训练部分。

The trainable parameters of Transformer Blocks in ImageReward can be reduced.

xujz18 avatar Aug 01 '24 07:08 xujz18