server icon indicating copy to clipboard operation
server copied to clipboard

run testing triton fail

Open LucQueen opened this issue 2 years ago • 2 comments

libtorch_int32_int32_int32 | 1       | UNAVAILABLE: Internal: input 'INPUT0' does not follow naming convention i.e. <name>__<index>. |
| libtorch_int32_int32_int32 | 2       | UNAVAILABLE: Internal: input 'INPUT0' does not follow naming convention i.e. <name>__<index>. |
| libtorch_int32_int32_int32 | 3       | UNAVAILABLE: Internal: input 'INPUT0' does not follow naming convention i.e. <name>__<index>. |

when i run the ci test, i get this error, because in the config.pbtxt, the name of model's input is INPUT0, not INPUT__0, so it fails,but i follow the instructions to generate ci test as below: $ cd qa/common $ ./gen_qa_model_repository $ ./gen_qa_custom_ops https://github.com/triton-inference-server/server/blob/main/docs/test.md can someone tell me why are the config and the code is not consistent?thanks

LucQueen avatar Jul 20 '22 06:07 LucQueen

Hi @LucQueen, can you clarify which test you are running? You can read more about the PyTorch naming conventions here: https://github.com/triton-inference-server/server/blob/main/docs/model_configuration.md#special-conventions-for-pytorch-backend

Tabrizian avatar Jul 20 '22 16:07 Tabrizian

What is the version of Torch backend that you used? We recently added changes to relax the convention restriction as posted above and I believe the new test models are generated without the convention.

GuanLuo avatar Jul 26 '22 19:07 GuanLuo

Closing issue due to lack of activity. Please re-open the issue if you would like to follow up with this.

krishung5 avatar Sep 07 '22 21:09 krishung5