serving

serving copied to clipboard

Support for TensorFlow pluggable devices

1

### Describe the problem the feature is intended to solve TensorFlow's pluggable device architecture offers a plugin mechanism for registering devices with TensorFlow without the need to make changes in...

pksubbarao

Cannot load saved model from S3 bucket after tensorflow-serving 2.7

21

## Bug Report If this is a bug report, please fill out the following form in full: ### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: -...

jeongukjae

Where do you add --model_config_file argument to a yaml configuration?

1

I've been having a hell of a time trying to figure-out how to serve multiple models using a yaml configuration file for K8s. I can run directly in Bash using...

rolandwang19

issues with building tfx r2.8 from source with mkl support

13

### Describe the problem the feature is intended to solve When building tfx r2.8-rc0 with mkl support, I see the following issue: ``` ERROR: /root/.cache/bazel/_bazel_root/c206fe4b7a49887ed31d86472abc6776/external/org_tensorflow/tensorflow/core/common_runtime/BUILD:1739:11: Couldn't build file external/org_tensorflow/tensorflow/core/common_runtime/_objs/threadpool_device/threadpool_device.o: C++...

hsl89

Can we reload the batch config after the server starts ? I see model config has such function. _Originally posted by @mikezhang95 in https://github.com/tensorflow/serving/issues/344#issuecomment-631395316_

mehransi

Steps: 1) Download [st5-large](https://tfhub.dev/google/sentence-t5/st5-large/1) 2) Load it from a tensorflow-serving docker container, latest-gpu or nightly-gpu 3) Send an inference request to the model 4) Observe error log: ``` [evhttp_server.cc :...

narkive

Please go to Stack Overflow for help and support: https://stackoverflow.com/questions/tagged/tensorflow-serving If you open a GitHub issue, here is our policy: 1. It must be a bug, a feature request, or...

Henry-Avery

## Feature Request If this is a feature request, please fill out the following form in full: ### Describe the problem the feature is intended to solve I'm always frustrated...

piEsposito

tfs:aarch64: add docker file to build aarch64 mkl configuration

10

This PR is dependent on https://github.com/tensorflow/serving/pull/1953

snadampal

Docs for batching parameter `pad_variable_length_inputs`

5

When I use TF-Serving with batching options and variable length inputs, I could get errors like `Tensors with name 'example_feature:0' from different tasks have different shapes and padding is turned...

jeongukjae