serving

serving copied to clipboard

Failed to read ModelServerConfig file: s3 (Minio) Tensorflow Serving (2.8->2.9)

7

I can't use s3 (minio) with TensorFlow serving version (2.8->2.9) on Docker. It gets an error: ```bash Failed to start the server. Error: UNIMPLEMENTED: File system scheme 's3' not implemented...

whoisltd

TFServing 2.10.0 crashes when slicing tensor

4

## Bug Report ### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Linux - **TensorFlow Serving installed from (source or binary)**: docker image - **TensorFlow Serving version**:...

battuzz

Reshape layer throws std::bad_alloc

12

### System information - OS: * Windows 11, 21H2, build 22000.856 * WSL2, Ubuntu 22.04 -- allocated 8Gb in .wslconfig - TF Serving installed using docker, version 2.9.1 - Hardware:...

Saoqq

…rs/http_server.cc and all net_http files accordingly. Also, removed everything from net_http/client except test_client to make room for new client API and basic implementation as specified in pull request #1912

jeremiahmao

Lazily load models and on insufficient resources for a load, look to unload idle models

16

## Feature Request ### Describe the problem the feature is intended to solve I have thousands of models to be served, but quite a big part of these models are...

kimjuny

Not enough documentation on building the model to serve for What-If Tool

6

I have seen through both documentation and API documentation for save and many other functions related to model building but I could not find enough documentation about building a model...

modbender

details of inter_op and intra_op parallelism threads

1

There exist two configuration parameters in TensorFlow serving to utilize CPU called `tensorflow_intra_op_parallelism` and `tensorflow_inter_op_parallelism` which tuning them can have great impact on the model server performance (throughput, latency). I...

mehransi

the same savedModel can be loaded by tf-serving 2.2, but can not be loaded by tf-serving 2.5.2 when using s3 storage

3

### System information - **OS Platform and Distribution (Linux Ubuntu 16.04)**: - **TensorFlow Serving installed from (source and binary)**: - **TensorFlow Serving version is 2.5.2**: ### Describe the problem 1....

liaocz

Unable to connect client side script to server side tensorflow_model_server via GRPC

1

I'm trying to server my Object Detection model via TF Serving and I'm unable to get results on the client side script.  I'm running this in...

shantanu-deepquanty

Updating link for GPU docker file

1

Updating link for GPU docker file from "https://github.com/tensorflow/serving/blob/master/tensorflow_serving/tools/docker/Dockerfile.devel-gpu" to "https://github.com/tensorflow/serving/blob/master/tensorflow_serving/tools/docker/Dockerfile.gpu". Reference Issue: https://github.com/tensorflow/serving/issues/2053

singhniraj08