Kundan Kumar

icon location BANGALORE

Results 1 comments of Kundan Kumar

Divide by zero: request_metrics[common_metrics.REQ_OUTPUT_THROUGHPUT] = num_output_tokens / request_metrics[common_metrics.E2E_LAT]

Here is the fix for this issue: https://github.com/ray-project/llmperf/pull/93