scalar27

use existing llama.cpp install

7

I've been using llama.cpp for quite a while (M1 Mac). Is there a way I can get ai_voicetalk_local.py to point to that installation instead of reinstalling it here? Sorry, newbie...

Please make a version that uses llama.cpp's server

1

Please consider making a version that uses llama.cpp's server instead of ollama. This would give better flexibility in terms of trying new models and settings. Thanks.

use llama.cpp instead of ollama

2

What would be involved in getting some of these apps, e.g., chat with pdf, to work with llama.cpp instead of ollama? I'm a big fan of llama.cpp (on a Mac)....