vaiju1981

There is no way to discover what other models that are not part of ollama space ( like users space )

One can also use DJL to load GGUF locally. https://github.com/deepjavalibrary/djl/tree/master/engines/llama . We use that for local testing. It uses Llama.cpp and calls it via JNI. --Thanks and Regards Vaijanath On...