paddlepaddle_backend icon indicating copy to clipboard operation
paddlepaddle_backend copied to clipboard

Any plan to update to latest triton version? (23.07)

Open bdeng3 opened this issue 1 year ago • 2 comments

So far the latest publicly available triton inference server with paddle backend is paddlepaddle/triton_paddle:21.10 and there are lots of bug fixes since then. I'm experiencing an increasing amount of bugs that are related older version of triton. Can Paddle Org provides an official update to the triton image?

Or is there any way we could install paddle backend in the latest triton inference server image ourselves?

bdeng3 avatar Aug 04 '23 23:08 bdeng3

For some reason, there is no time to upgrade the triton version. It is expected that the triton version will be updated in September or October.

heliqi avatar Aug 07 '23 03:08 heliqi

One interface needs to be modified to install paddle backend on the latest triton version https://github.com/triton-inference-server/paddlepaddle_backend/blob/6c1c935e9978f5606082cfb372cc74948bcb6e7a/src/paddle.cc#L883

heliqi avatar Aug 07 '23 03:08 heliqi