Alexander Mamaev

What about pip package?

1

I think, that that model will more helpful for using if I can install it by pip.

How stub methods are using?

2

I'm trying to get up how everything works in underhood, so can you please explain how `stub` methods in core code are using for? I thought it might be used...

Core rebuild is extremely long

5

I'm trying to add my specific functionality into triton-core, but rebuilding and testing this is exceptionally long. Most of the time spends on [grpc-patching](https://github.com/triton-inference-server/third_party/blob/d114b9982a6d293458c040827c38da2d8ee78c30/CMakeLists.txt#L148) which is just a dumb copy...

Show ensemble stage where error happens

1

For now, if an error happens at some stage of the ensemble it prints something like `tritonclient.utils.InferenceServerException: [StatusCode.INTERNAL] in ensemble 'tts', PyTorch execute failure: The following operation failed in the...

Tests for backend examples

3

I want to create an new backend for triton server, but actually i don't want to every time load `so` file into triton and then check it, because its a...