server icon indicating copy to clipboard operation
server copied to clipboard
verified publisher icon triton-inference-server

Add testing for decoupled model use case

Open krishung5 opened this issue 1 year ago • 0 comments

Testing added for the specific use case of launching a separate thread for decoupled models. Fixed a small issue for the CI as well.

PYBE: https://github.com/triton-inference-server/python_backend/pull/358

krishung5 avatar May 20 '24 21:05 krishung5