rag-chatbot icon indicating copy to clipboard operation
rag-chatbot copied to clipboard

Published 20 hours ago • verified publisher icon datvodinh

Can I run this on my 6GB VRAM RTHX 3060 laptop gpu?

Open shashankyld opened this issue 5 months ago • 0 comments

I get an error after pulling and loading the model (llama 8B). It says ready but then given a prompt it fails immediately.

shashankyld avatar Sep 17 '24 16:09 shashankyld