Larry

icon indicating a website link https://www.jianshu.com/u/51ee4397ee8b icon indicating an email [email protected]

icon company Alibaba Cloud Intelligence icon location Hangzhou, China icon location Machine Learning Algorithm Engineer

Results 3 issues of Larry

add batch operation.

1.add batch operation for large dataset. 2.update tensorflow api parameter.

RT-DETR FP16 inference get correct result on v100 but weird result on a10

2 comment

## Description I am using tritonserver:23.10 to deploy RT-DETR model. The onnxruntime fp32, onnxruntime fp16 and Tesla V100 TRT 8.6.1 FP16/F32 both get the correct result. But Tesla A10 TRT...

triaged

Can't find libdali.so when use DALI backend

**Description** UNAVAILABLE: Not found: unable to load shared library: libdali.so: cannot open shared object file: No such file or directory ![image](https://github.com/user-attachments/assets/d9cc1628-cc20-459c-ae42-6cae421ca7e7) **Triton Information** tritonserver:24.08-py3 Are you using the Triton container...