paddlepaddle_backend
paddlepaddle_backend copied to clipboard
Any plan to update to latest triton version? (23.07)
So far the latest publicly available triton inference server with paddle backend is paddlepaddle/triton_paddle:21.10
and there are lots of bug fixes since then. I'm experiencing an increasing amount of bugs that are related older version of triton. Can Paddle Org provides an official update to the triton image?
Or is there any way we could install paddle backend in the latest triton inference server image ourselves?
For some reason, there is no time to upgrade the triton version. It is expected that the triton version will be updated in September or October.
One interface needs to be modified to install paddle backend on the latest triton version https://github.com/triton-inference-server/paddlepaddle_backend/blob/6c1c935e9978f5606082cfb372cc74948bcb6e7a/src/paddle.cc#L883