Jeffry Samuel
Jeffry Samuel
Alpaca uses the OpenAI library to talk to external instances (anything that isn't Ollama). llama.cpp isn't officially supported and I'm not sure how it interacts with OpenAI.
I'll look into it, thanks for the report
Hi sorry for not responding earlier, because of the way Alpaca handles tools I can't just add everything into a single tool but I'll take a look at the available...
A good way of telling if a model can run is by converting it size to GB like this and adding 2GB Qwen3 (4B) -> 4GB + 2GB = 6GB...
Just click the button again to stop it
I mean I don't know how much intuitive it can be, it's a toggle button, it toggles
well I would need the logs or at least a video
Sounds interesting, I'll look into it once I get some free time. Do you think this should be a special chat or a separate page (like the model manager)?
I decided to try to make this the big feature for Alpaca 7, so probably in a couple of months. I think this is a great feature and I could...
I know I said Alpaca 7 but this has proven more difficult than I thought, so I'll push it over to Alpaca 8