serving
serving copied to clipboard
A flexible, high-performance serving system for machine learning models
## Feature Request Add the `process_start_time_seconds` metrics to the prometheus metrics. ### Describe the problem the feature is intended to solve In order to be able to utilise cumulative metrics...
Hi, I'm trying to build a serving lib by blade build tensorflow_serving/model_servers:server_lib. It really generates statitc and shared libs, such as libserver_lib.a and libserver_lib.so . But, these libs can not...
Fixes #1542 This is a starter kit to add support for building CentOS 7 based Docker images that'd be maintained in parallel to the Ubuntu based ones. There are some...
### Describe the problem the feature is intended to solve tensorboard profiler not working with latest tensorflow serving master commit ### System information - **OS Platform and Distribution (e.g., Linux...
### Describe the problem the feature is intended to solve I have several models loaded and not sure how can I know if Tensorflow still has some memory left. I...
TF serving GPU build fails to execute on CPU only machines without CUDA and TensorRT dependencies.
### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: - **TensorFlow Serving installed from (source or binary)**: - **TensorFlow Serving version**: ### Describe the problem Our team...
When `tensorflow-cpu` is already installed, `tensorflow-serving-api` package cannot detect tensorflow installation. `https://pypi.org/project/tensorflow-serving-api/` should follow `tensorflow-cpu` `https://pypi.org/project/tensorflow-serving-api-gpu/` is now folloing `tensorflow-gpu` requirement.
I am able to host a custom-tensorflow model with tf-serving, but that model accepts image in matrix form [None, None, None,3]. But I want to make changes such that it...
### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: ubuntu 18.04 - **TensorFlow Serving installed from (source or binary)**: binary - **TensorFlow Serving version**: 1.14 ### Describe...