tensorrt-laboratory
tensorrt-laboratory copied to clipboard
Enable gRPC deadlines in Client/Server
We don't do a good job of checking gRPC deadlines as outlined in this blog post: https://grpc.io/blog/deadlines
Just wanted to comment that support for deadlines (from the client side) is very important for the async callback mode (which seems to be an active area of development). Even the simple example code at simple_callback_client.cc will hang if one of the requests doesn't come back.