serving
serving copied to clipboard
A flexible, high-performance serving system for machine learning models
tensorflow_model_server with --model_base_path pointing to a gs:// bucket getting too long to start.
### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Ubuntu 16.04 - **TensorFlow Serving installed from (source or binary)**: Docker image - **TensorFlow Serving version**: tensorflow/serving:2.2.0 I'm...
Hi, I have built the TF DF model and I am trying to serve it using Docker, I am using the following commands: ``` # Saved the model using the...
## Feature Request ### Describe the problem the feature is intended to solve Based on the interest in the community and in my team on supporting the TF serving [service]...
## Bug Report TFS using GPU Memory very much! ### System information - **OS Platform and Distribution: CentOS 8.4, Cuda 11.4 - **TensorFlow Serving installed from: Docker - **TensorFlow Serving...
Signed-off-by: Abolfazl Shahbazi For some reason when downloading repo with `curl` I get the following error while building `2.5.1` image for `Intel MKL`: ``` root@f881d27588d3:/tensorflow-serving# export TF_SERVING_BUILD_OPTIONS='--config=mkl --config=release' root@f881d27588d3:/tensorflow-serving# export...
### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Linux Ubuntu 20.04 on s390x - **TensorFlow Serving installed from (source or binary)**: Source - **TensorFlow Serving version**:...
## Bug Report ### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: - Ubuntu 18.4 LTS. (x64 server and x64 laptop) - Nvidia Linux for Tegra (Based...
Please go to Stack Overflow for help and support: https://stackoverflow.com/questions/tagged/tensorflow-serving If you open a GitHub issue, here is our policy: 1. It must be a bug, a feature request, or...
This patch is essentially porting the patch submitted by @njhill in PR #1518 to `2.4.0` version Currently when the configured model list is updated via a call to handleReloadConfigRequest, the...