server
server copied to clipboard
triton-inference-server
Setting tensor name in python bls
This is really for Python backend, but I can't find issue page there. I noticed that in source code of python backend, PbTensor class has a method SetName, but not implemented. This method is pretty useful for bls. Sometimes we need to pass some tensors from one model's output to another one's input, but the tensor name is different. Currently we can only do so using as_numpy or to_dlpack to get the content out and create a new tensor. It would be really nice that the method gets implemented.
