ort icon indicating copy to clipboard operation
ort copied to clipboard

Does it support TensorRT backend?

Open jinluyang opened this issue 1 year ago • 0 comments

Hello, great job. In the README it seems we just support CUDA backend and openVINO backend but how about TensorRT backend which is used in ONNXruntime by default on Nvidia GPUs? Do we have any benchmark about speedup? Do we aim at providing a solution for deploying transformers? How about the roadmap?

jinluyang avatar Nov 06 '23 02:11 jinluyang