serving

serving copied to clipboard

GPU Memory allocation with multiple cuda stream

1

sorry for bothering! I am trying to deploy a model with dynamic connection of our company to production environment. Since the model is dynamically activated, so batching requests and do...

Joeyzhouqihui

Error: Batched output tensor's 0th dimension does not equal the sum of the 0th dimension sizes of the input tensors

4

### System information - **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 40 bits physical, 48 bits virtual...

RajezMariner

Will anyone mount paddlegan?

1

Will anyone mount paddlegan?

bbhxwl

## Bug Report If this is a bug report, please fill out the following form in full: ### System information - **Linux Ubuntu 18.04**: - **TensorFlow Serving 2.7.3**: ### Describe...

Jitendradubey

## Bug Report If this is a bug report, please fill out the following form in full: ### System information - **OS Platform and Distribution**: Centos8 - **TensorFlow Serving installed...

Emeralddddd

Add latest_once version policy

1

Hi, we are trying to open source our training/serving framework based on tensorflow. It includes several patches to tensorflow and tensorflow serving. We want to eliminate those patches by merging...

zhuyijie

Hello 👋 I run a security community that finds and fixes vulnerabilities in OSS. A researcher (@rook1337) has found a potential issue, which I would be eager to share with...

psmoros

Critical Vulnerability

3

Hello team, We have found a critical vulnerability, Please check here https://huntr.com/bounties/21653366-4497-4bd9-9510-1770a86f8af2

rook1337

CPU Memory occupied by TF Serving even though serving is on GPU

4

### System information - TensorFlow Serving v2.11 installed from source ### Describe the problem We are running TensorFlow Serving on GPU as a separate process which is interacting with the...

ndeep27

Mismatch between TensorRT version used in TF 2.14 GPU docker images for tensorflow/serving and tensorflow/tensorflow causes segfault during inference

1

Please go to Stack Overflow for help and support: https://stackoverflow.com/questions/tagged/tensorflow-serving If you open a GitHub issue, here is our policy: 1. It must be a bug, a feature request, or...

saimidu