yokie121 comments

Repositories
Issues
Comments

Results 3 comments of


                                            yokie121

We have encountered some problems while trying to do the inference via two NVIDIA A10 GPUs

> AssertionError: Loading a checkpoint for MP=0 but world size is 1 ERROR:torch.distributed.elastic.multiprocessing.api:failed (exitcode: 1) local_rank: 0 (pid: 1769) of binary: /usr/bin/python3 I have the problem .

Distributing LLaMA on multiple machines within the same network

it's greate !! we want to know how to work on the larger models 13B or 65B. ? thanks !

Plain pytorch LLaMA implementation (no fairscale, use as many GPUs as you want)

You can run vanilla-llama on 1, 2, 4, 8 or 100 GPUs. i want to know how to do it ? thanks