TensorRT-LLM
TensorRT-LLM copied to clipboard
[Question] What is the difference between gptManagerBenchmark and gptSessionBenchmark in cpp benchmarks?
version of TensorRT-LLM: v0.11.0
What is the difference between gptManagerBenchmark and gptSessionBenchmark in cpp benchmarks, please give me some example scenarios of using each benchmark script, thans a lot :)