Ziyang Huang

icon location Beijing icon location Research on NLP.

Results 1 comments of Ziyang Huang

Can not run 13B inference model. After loading the ckpt, it just stoped and the gpus are still occupied.

> Sounds like it is indeed running the inference model. It will hang there till it actually completes its inference. If the GPU's are occupied that sounds like its doing...