serving

serving copied to clipboard

How to configure GPU memory limit for each model in one serving

3

How to configure GPU memory limit for each model in one serving? i just found configure "one serving instance" gpu memory limit with platform_config_file->per_process_gpu_memory_fraction how can i configure each model...

motocoder-cn

Upgrade examples to TensorFlow 2 in develop and 2.x docker images

2

Now we follow the official documents to build and test tensorflow serving with latest dev docker image. The examples can not be run successfully because the tensorflow version is 2.1.0...

tobegit3hub

Docker container is not crashing, getting killed/aborted but only print out errors on GPU out of memory!

3

## Bug Report ### Describe the problem How should I restart / reload my model that has been running inside a tf-serving docker container when it goes out of memory...

spate141

## Feature Request If this is a feature request, please fill out the following form in full: ### Describe the problem the feature is intended to solve In Kserve, we...

alexagriffith

Logging - json format / custom format

3

## Feature Request ### Describe the problem the feature is intended to solve My organization allows logs to be persisted only if they follow certain standards. As the current Tensorflow...

GautamSinghania

`No module named 'tensorflow.compat` when trying to run experimental remote_predict op.

5

## Bug Report ### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Ubuntu 18.04 - **TensorFlow Serving installed from (source or binary)**: source - **TensorFlow Serving version**:...

rrkarim

TF GPU builds are now fully functional even in the absence of a GPU. We can follow the same paradigm for consistency and simplicity of our release. One potential concern...

peddybeats

After this commit https://github.com/tensorflow/tensorflow/commit/2105f7fb148035b9198f278d702e14bbc821a526 in the Tensorflow repository, the dependency tensorflow-gpu isn't available for installation anymore If you will try to build tensorflow/serving from master now, you will get the...

dchebakov

Updated Broken link for SavedModel Warmup

1

I have updated this broken link (https://github.com/tensorflow/serving/blob/master/tensorflow_serving/g3doc/saved_model_warmup) which was under this hyperlink (model warmup) to new hyperlink (https://github.com/tensorflow/serving/blob/master/tensorflow_serving/g3doc/saved_model_warmup.md)

gaikwadrahul8

Update broken links signature_defs.md

1

Updated broken links in Background section of signature_def.md file.

singhniraj08