server
server copied to clipboard
What is the difference between `Plattform` and `Backend`
Description
After reading about the triton sever I don't fully understand the difference between the backend and platform parameter. They seem to represent the same thing but use slightly different tags. One example form the docs are:
For TensorRT, 'backend' must be set to tensorrt or 'platform' must be set to tensorrt_plan.
Why should the users set one or the other? Are one legacy and one is the recommended? Are there any differences at all? Why are there multiple ways to set the same thing?
Triton Information
To Reproduce
Expected behavior
Did not know where to post, let me know if this is the wrong place and where I can move it. Thanks for the help!
The platform field is the legacy field and the backend field is the new convention. There is no difference in terms of functionality at all. Specifying platform: tensorrt_plan or backend: tensorrt would lead to the same backend being used.
Great, would it make sens to add this to the docs @Tabrizian? I would be happy to make a PR for it.
Closing this issue as the PR has been merged. Thanks again for your contribution.