TensorRT-LLM icon indicating copy to clipboard operation
TensorRT-LLM copied to clipboard

[Question] What is the difference between gptManagerBenchmark and gptSessionBenchmark in cpp benchmarks?

Open hcnhcn012 opened this issue 1 year ago • 0 comments

version of TensorRT-LLM: v0.11.0

What is the difference between gptManagerBenchmark and gptSessionBenchmark in cpp benchmarks, please give me some example scenarios of using each benchmark script, thans a lot :)

hcnhcn012 avatar Aug 06 '24 09:08 hcnhcn012