Yi Luo

icon indicating an email [email protected]

icon company Intel icon location Shanghai, China

Results 1 comments of Yi Luo

[Core] Add retention policy code for processing requests

Which parameter in vLLM server corresponds to TGI's --max-concurrent-requests? When can the VLLM_ENGINE_MAX_CONCURRENT_REQUESTS parameter be used?