Results
13
comments of
garycao
> > > chatglm-6b is not supported at the moment as it requires additional python dependencies. > > > > > > Is there any way to deploy chatglm through...
thank you, chatglm2-6b works in AutoModelForCausalLM mode and the batch size shoud be 1. when batch > 1, I got error below : { "error": "Request failed during generation: Server...
> --max-concurrent-requests 1