JamesLYan

Inference freezes when running llama example with pp>2

3

Hi, I am trying to run the example script provided for llama model for inference only. Since the repository is going through migration and a lot of changes, I went...