Triton-TensorRT-Inference-CRAFT-pytorch icon indicating copy to clipboard operation
Triton-TensorRT-Inference-CRAFT-pytorch copied to clipboard

Published 20 hours ago • verified publisher icon k9ele7en
→

Metadata

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server -...

Results 1 Triton-TensorRT-Inference-CRAFT-pytorch issues
Sort by recently updated
recently updated
newest added

speedup

10 comment

hello, I found that there is speedup using tensorrt(fp32, fp16) inference, is that right? And I found that batch inference for torch model has no speedup too. I do not...

ltm920716 avatar ltm920716

← Metadata

31
Stars
6
Forks
Watchers

Owner

verified publisher icon k9ele7en

Metadata

Advanced inference pipeline using NVIDIA Triton Inference Server for CRAFT Text detection (Pytorch), included converter from Pytorch -> ONNX -> TensorRT, Inference pipelines (TensorRT, Triton server -...

Back