ColossalAI
ColossalAI copied to clipboard
[benchmark]: llama add tokens metrics
When benchmarking a LLM, token/s is also an important metric, so this metric is added to the llama benchmark.