Ayan
Ayan
Hi, how to handle multiple request by your fast api? when i send 2 request to the: `0.0.0.0:8001/v1/completions` at the same time, service go down (((( Error: ``` Llama.generate: prefix-match...
Can you add a feval function like in lightgbm.train? It is the customized evaluation function. Each evaluation function should accept two parameters: preds, eval_data, and return (eval_name, eval_result, is_higher_better) or...