Niraj Singh
Niraj Singh
@gggh000 , Apologies for delayed response, I was unable to replicate your issue with demo models preloaded with tf serving. I pulled the latest `tensorflow-serving` image, ran the docker image...
Closing this due to inactivity. Please take a look into the answers provided above, feel free to reopen and post your comments(if you still have queries on this). Thank you!
@ghost, TensorFlow Serving has two API surfaces (HTTP and gRPC), both of which implement the [PredictionService API](https://github.com/tensorflow/serving/blob/r2.0/tensorflow_serving/apis/prediction_service.proto#L15). Both API surfaces are highly tuned and add minimal latency. In case if...
@ningwudm00, I was unable to replicate the issue with TF serving 2.8. I am able to deploy the model on port 8501 and get successful predictions. Attached [gist](https://colab.sandbox.google.com/gist/singhniraj08/7d01b4a457be3e77940b3f9c7bf64197/10-deploy-models-using-tensorflow-serving.ipynb). Please take...
Closing this due to inactivity. Please take a look into the answers provided above, feel free to reopen and post your comments(if you still have queries on this). Thank you!
@apivovarov, Because of GRPC build issue, `Ubuntu CPU` and `import/copybara` were failing but the issue has been fixed and latest PRs triggers CI and the build succeeded. Rest assured, the...
@1dustycy, You can find community build Golang packages for TF Serving Client [here](https://pkg.go.dev/github.com/applifier/go-tensorflow/serving) and [here](https://github.com/jeongukjae/tensorflow-serving-apis-proto) as mentioned in above [comment](https://github.com/tensorflow/serving/issues/1365#issuecomment-1002447012). Please let us know if this issue can be closed....
@Cazyshark, The recommended approach to building from source is to use Docker. The TensorFlow Serving Docker development images encapsulate all the dependencies you need to build your own version of...
@dummy26, The old link http://www.tensorflow.org/serving shown in `tensorflow/serving` repo will redirect users to new link https://www.tensorflow.org/tfx/guide/serving Thank you for bringing this up. Kindly let us know if this issue can...
@oohx, Could you please provide some more information for us to debug this issue? We would like to understand how the same model with same batching data performs in Tensorflow....