JamesLYan comments

Repositories
Issues
Comments

Results 3 comments of


                                            JamesLYan

Startup is extremely slow in wsl2 environment

I seem to have the same problem with neovim in wsl2.

Inference freezes when running llama example with pp>2

> Indeed, we are migrating pippy into pytorch, see: https://github.com/pytorch/pytorch/tree/main/torch/distributed/pipelining > > Does the script work for pp > 2 but without cpu-init? Unfortunately with the Llama2-7b-hf model , if...

Inference freezes when running llama example with pp>2

I tried downgrading torch to stable 2.3.0 and the same problem occurs. The example script that I am running is `/examples/llama/pippy_llama.py`. Since this could be a problem with `Pippy v0.2.0`,...