yukiyee issues

Repositories
Issues
Comments

Results 2 issues of


                                            yukiyee

[BUG]: How to run llama2 70B pretrain on 32gpus? I got OOM error on almost every plugin and config.

### 🐛 Describe the bug gemini / gemini_auto / zero2 / hybrid_parallel I have tried and still got OOM error. with hybrid_parallel plugin , I tried configs as follows: 1....

bug

[BUG]: llama2 training on multi-node slurm, report error: errno: 98 - Address already in use

### 🐛 Describe the bug ``` RuntimeError: The server socket has failed to listen on any local network address. The server socket has failed to bind to [::]:29601 (errno: 98...

bug