ramalama
ramalama copied to clipboard
Multi-model server support
Discussed here:
https://github.com/containers/ramalama/issues/239
https://github.com/abetlen/llama-cpp-python/blob/7c4aead82d349469bbbe7d8c0f4678825873c039/docs/server.md#configuration-and-multi-model-support