torchft icon indicating copy to clipboard operation
torchft copied to clipboard

Published 20 hours ago • verified publisher icon meta-pytorch

Disable async quorum for the first quorum sync

Open fegin opened this issue 9 months ago • 1 comments

If we don't wait for the first quorum, the trainer will continue to run forward and may use incorrect weights if the trainer is healing.

fegin avatar Feb 19 '25 08:02 fegin