Haozhi Tan

Running forever when running Llama-3 model locally

2

Dear LLMWare Team, I hope this message finds you well. I'm trying to use model 'bartowski/Meta-Llama-3-8B-Instruct-GGUF' following the example https://github.com/llmware-ai/llmware/blob/main/examples/Models/using-llama-3.py, but it take forever to run and it looks like...