airllm icon indicating copy to clipboard operation
airllm copied to clipboard

So much time loading

Open Alvaro8gb opened this issue 1 year ago • 2 comments

I am attempting to run Llama13b using an NVIDIA GeForce RTX 3090, but the model never completes loading. image

Alvaro8gb avatar Dec 11 '23 10:12 Alvaro8gb

can you provide a stack trace?

lyogavin avatar Dec 13 '23 15:12 lyogavin

"Hey @lyogavin thanks for your time, there is no trace to provide because the program hasn't finished after 177 minutes.

Alvaro8gb avatar Dec 26 '23 13:12 Alvaro8gb