__mo_san__
__mo_san__
@awni your thoughts please!
don't we need to add param groups for this as well?
When implementing learning rate schedules, it is common to assign distinct learning rates to various parameter groups. For instance, in models with separate components like the Head and Body, updating...
Hello @SkafteNicki, which of these are not yet claimed?