DeepSpeed-MII icon indicating copy to clipboard operation
DeepSpeed-MII copied to clipboard

Configure server log level

Open sedletsky-f5 opened this issue 1 year ago • 2 comments

Please add one or more params to control logs from RESTful API server - namely in mii.serve() function. You can see as reference -log- config params in vLLM: https://docs.vllm.ai/en/latest/serving/openai_compatible_server.html#command-line-arguments-for-the-server

It is especially important at startup, when there is a huge amount of logs (from several processes).

sedletsky-f5 avatar Jun 19 '24 21:06 sedletsky-f5

Hi @sedletsky-f5 - we will try to prioritize this, in the meantime, if you are able or willing, would you consider making a PR and we can review and get it merged?

loadams avatar Jul 01 '24 19:07 loadams

thanks @loadams , I will wait for you implementation (I didn't get into the code to make this change)

sedletsky-f5 avatar Jul 02 '24 04:07 sedletsky-f5