paddlepaddle_backend
paddlepaddle_backend copied to clipboard
Can not use disenable_trt_tune option
I want to use TRT and set disenable_trt_tune
option is True
but get an exception below:
unknown parameter 'disenable_trt_tune` is provided for GPU execution accelerator config. Available choices are [precision, min_graph_size, workspace_size, max_batch_size, enable_tensorrt_oss, is_dynamic]
But i saw that this option available here.
This is Docker image base and config.pbtxt
for execution accelerators with tensorrt:
- Docker image
https://hub.docker.com/r/paddlepaddle/triton_paddle
- Configs.pbtxt
optimization {
execution_accelerators {
gpu_execution_accelerator : [
{
name : "tensorrt"
parameters { key: "precision" value: "trt_fp16" }
parameters { key: "min_graph_size" value: "30" }
parameters { key: "max_batch_size" value: "32" }
parameters { key: "workspace_size" value: "1073741824" }
parameters { key: "is_dynamic" value: "1" }
parameters { key: "disenable_trt_tune" value: "1" }
}
]
}
}
Please help me asps, thank you !!! 🥺️🥺️🥺️
@nhhviet98 My friend, could you send me a Docker image package? Thank you very much!
@nhhviet98 My friend, could you send me a Docker image package? Thank you very much!
I've used the official image from here
@nhhviet98 My friend, could you send me a Docker image package? Thank you very much!
I've used the official image from here
I have tried this method. It may fail to pull the mirror image due to network reasons.