tkdcjf159
Results
1
comments of
tkdcjf159
@RezaYazdaniAminabadi Thank you for letting me know. I'm not sure if this is related to the issue, but when the reduce_bucket_size and allgather_bucket_size are small (e.g. hidden_size * hidden_size) in...