calculate-flops.pytorch icon indicating copy to clipboard operation
calculate-flops.pytorch copied to clipboard

Published 20 hours ago • verified publisher icon MrYxJ

How to calculate the FLOPs when the model has some freezed variables, or using LoRA?

Open Ledzy opened this issue 8 months ago • 0 comments

I suppose the corresponding backward calculations should be discarded.

Ledzy avatar Jun 23 '24 09:06 Ledzy