ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

[benchmark]: llama add tokens metrics

Open zeroorhero opened this issue 6 months ago • 1 comments

When benchmarking a LLM, token/s is also an important metric, so this metric is added to the llama benchmark.

zeroorhero avatar Jul 25 '24 01:07 zeroorhero