TensorRT
TensorRT copied to clipboard
Unclear documentation and/or duplicate value in performance summary from trtex/trt-engine-explorer
When profiling a model wiht.. a model.engine.profile.metadata.json is created. the performance_summary: "Latency" contains 7 values. while in:
, it is mentioned that it should contain: [min, max, mean, median, 99% percentile], 5 values. What are the other 2 values? The same holds for: "Enqueue Time", "H2D Latency", "GPU Compute Time", "D2H Latency" values. Which from [min, max, mean, median, 99% percentile] can be take from which possition?
Can you please share a log where the 7 values are logged and where it is mentioned that it should contain [min, max, mean, median, 99% percentile]?