torchrec icon indicating copy to clipboard operation
torchrec copied to clipboard

how to freeze embedding

Open threestone965 opened this issue 7 months ago • 0 comments

i want to freeze EmbeddingCollection mid training, but setting the learning rate to 0.0 does not save cuda memory and computing resources. is there a method similar to the following code. looking forward to your reply, thanks

for param in module.parameters():
        param.requires_grad = False

threestone965 avatar Apr 23 '25 02:04 threestone965