serving
serving copied to clipboard
tensorflow
A flexible, high-performance serving system for machine learning models
Please let me know if I misunderstood the original intention. * Parallel warm-up options were exposed a very long time ago, but AFAIK, there is no way to set it...
I thought the JSON key of regress and classify response is `results`, not `result`. When I follow Example section of https://www.tensorflow.org/tfx/serving/api_rest, I got the following response which the key is...
Doc fix: Updated broken link to publish docker ports
Hello, There seems to be a [known behaviour](https://github.com/tensorflow/serving/issues/2004) of infinite looping of trying to load a model when a model_path is not correct. To avoid that behaviour, I have found...
I am working on my book on adversarial AI: https://www.securitynik.com/2025/06/coming-soon-free-little-book-on.html and as part of that book I am talking about attacking the inference endpoint. As expected, version 2.18.0 of TF...
Hello, I was trying to build the latest version of TF Serving from source according to the instruction https://www.tensorflow.org/tfx/serving/setup . The build breaks because of wrong version of bazel: ```...
Created alternative PR as the original issuer doesn't have CLA signed.
# Issue Summary TensorFlow Serving built with TPU support fails to run in Docker containers with the error: ``` tensorflow/core/tpu/tpu_api_dlsym_initializer.cc:95] Opening library: terminate called after throwing an instance of 'std::filesystem::filesystem_error'...
Supersedes #2252 Applies pre-commit with Ruff rules from #2251 The description from #2252 applies here: > This PR fixes a bunch of existing lint issues that were automatically fixed by...
Metadata
Owner
Metadata
A flexible, high-performance serving system for machine learning models