Kevin Kuo

Results 1 issues of Kevin Kuo

Hi Teams, I have run the **default training script** with the following changes based on the results table **1. GLOBAL_BATCH_SIZE=16384 2. WORLD_SIZE=4 ( 4 A100 40GB GPUs)** P.S. **I did...