onnxruntime_backend icon indicating copy to clipboard operation
onnxruntime_backend copied to clipboard

how to use onnxruntime profiling in triton

Open cyh-ustc opened this issue 2 years ago • 0 comments
trafficstars

Is your feature request related to a problem? Please describe. triton trace api timing only contains total inference time how to get detailed timing like operator level. or kernel level?

Describe the solution you'd like

maybe by allowing onnxruntime enable profile options in model configuration

Additional context

https://onnxruntime.ai/docs/performance/tune-performance/profiling-tools.html

cyh-ustc avatar Jul 25 '23 05:07 cyh-ustc