Is it possible to make gRPC to use a unix socket instead of TCP in Triton Server?

[PauloFavero]

We have a streaming service that uses gRPC with Unix sockets. The gRPC performs way better with Unix socks in comparison with a TCP port. I saw that you can only change the port in the triton server for the gRPC connection.

An option to change the gRPC connection protocol could be viable in the future as a new feature? Is there a way to do that with the current implementation?

Thanks

[deadeyegoodwin]

It should be possible with changes to the server grpc implementation, but we haven't looked at it in detail.

[guoxiaojie-schinper]

I face the same problem. I deploy tritonserve and my application on the same machine, then I want to change the TCP proto to UNIX sock so that it can accelerate the inference speed, but there is no way to change this.

[andremoeller]

Adding a +1 to this enhancement request. @deadeyegoodwin -- wondering if your team has had a chance to scope this out?

[sakoush]

Yes this will be a very useful feature.

[kelevra1993]

Any updates on this ? Or anyone know how i would be able to start to try to code / implement this. For our current application we might benefit greatly.