pytorch-image-models icon indicating copy to clipboard operation
pytorch-image-models copied to clipboard

Published 20 hours ago • verified publisher icon huggingface

Gradient accumulation included into training script

Open lorenzbaraldi opened this issue 2 years ago • 1 comments

Added parameter 'iters_to_accumulate' to perform gradient accumulation during training.

lorenzbaraldi avatar Dec 12 '22 21:12 lorenzbaraldi

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

HuggingFaceDocBuilderDev avatar Dec 12 '22 21:12 HuggingFaceDocBuilderDev

@lorenzbaraldi thanks for the PR, sorry for leaving it sit for so long, I'm going with a slightly different approach via #1659 with some additional cleanup

rwightman avatar Apr 20 '23 06:04 rwightman