torchft
torchft copied to clipboard
Disable async quorum for the first quorum sync
If we don't wait for the first quorum, the trainer will continue to run forward and may use incorrect weights if the trainer is healing.