DeepSpeedExamples
DeepSpeedExamples copied to clipboard
Add openai client to deepspeedometer
This PR adds a new client which can test performance of LLM serving conforms to OpenAI API. This gives the flexibility of start a server seperately and benchmark that server from deepspeedometer.