podman-desktop-extension-ai-lab icon indicating copy to clipboard operation
podman-desktop-extension-ai-lab copied to clipboard

Published 20 hours ago • verified publisher icon containers

Allow to define Model Parameters

Open slemeur opened this issue 10 months ago • 0 comments

I'd like to be able to define the model parameters - which are really configuring the way the model serving is happening

https://github.com/abetlen/llama-cpp-python/blob/08e910f7a7e3657cf210ab8633a6994e1bde7164/llama_cpp/llama.py#L57-L109

As a user, I would also like to be able to see those parameters on a dedicated tabs of the Model service's details

slemeur avatar Mar 26 '24 09:03 slemeur