Daniel J Walsh
Daniel J Walsh
Make sure the service side is restarted?
@giuseppe PTAL
What does the docker inspect look like?
@ericcurtin @bmahabirbu PTAL
ramalama --debug --image **quay.io/ramalama/ramalama-rag** run --rag quay.io/csutherl/ragdata mistral:latest Need to use ramalama-rag image.
@afazekas PTAL
@simi @thom311 Still having problems?
I see this as an upstream issue with llama.cpp at this point and the only thing RamaLama might be able to do is to always select the ramalama/Vulkan image rather...