snow issues

Repositories
Issues
Comments

Results 2 issues of


                                            snow

Distributed training fails due to GPU reassignment logic conflicting with torchrun

In run.py, the PR #991 includes GPU assignment logic that conflicts with torchrun's automatic GPU distribution. I run the following command on 2x4090 setup: ```torchrun --nproc-per-node=2 run.py --data CountBenchQA --model...

snow

Distributed training fails due to GPU reassignment logic conflicting with torchrun

Add 4 bit inference capability