h2ogpt icon indicating copy to clipboard operation
h2ogpt copied to clipboard

question regarding model_lock

Open chengchu88 opened this issue 1 year ago • 0 comments

Hello all, I wonder if someone can tell me, when using model_lock to deploy mutliple inferencing gradio services, can I specifiy different LLM control parameters (temperature, top p, top N, etc.) at the CLI command (either the server or the client command)? thanks!

chengchu88 avatar May 22 '24 23:05 chengchu88