tensorrt

tensorrt copied to clipboard

i have error tf2.1 model to tensorRT 

zmqp111

TF-TRT 1.x Workflow With A Frozen Graph

1

chennuo0125-HIT

TensorRT is Unable to convert the FusedBatchNormV2 op

1

## Description TensorRT is unable to convert the FusedBatchNormV2 op. When I turn on verbose logging I see messages like this: ``` 2020-03-14 17:28:54.501494: I tensorflow/compiler/tf2tensorrt/segment/segment.cc:439] Not a TF-TRT candidate,...

danfischetti

Tf2.1.0, tensorrt7, batchSize > 0 && batchSize <= mEngine.getMaxBatchSize(). Note: Batch size was: 0, but engine max batch size was: 1

3

I try to generate tf-trt model by using tf2.1.0's TrtGraphConverterV2(xxxx) interface. In tf2.1.0's TrtGraphConverterV2, **the is_dynamic_op can only be Ture**, which means the tf-trt model can handle input images of...

jxhekang

convert model cost time and consuming memory too much

1

test platform : jetson agx xavier memory capacity : 32G os : jetpack4.3 tensorflow : 1.15 i optimize the [https://github.com/YunYang1994/tensorflow-yolov3](url) project with tf_trt, which cost about 15 minutes to load...

chennuo0125-HIT

Image Classification Example Int8 Quantization-Out of memory error

3

I'm trying to quantize TF-TRT INT 8 Model in Colab-TF-TRT-inference-from-Keras-saved-model.ipynb using Jupyter notebook. I faced gpu out of memory error. but i think i have enough gpu memory. ~~~ +-----------------------------------------------------------------------------+...

abc3698

TF-TRT is slow than native-TF with 512*512 image

5

We test [EAST ](https://github.com/argman/EAST)model using TF-TRT and native-TF on GPU V100. **_If image size is 256 * 256，for one inference TF-TRT takes 3ms and native-TF takes 4ms. If image size...

lxl910915

module 'tensorflow.contrib.tensorrt' has no attribute 'calib_graph_to_infer_graph'

3

module 'tensorflow.contrib.tensorrt' has no attribute 'calib_graph_to_infer_graph' TF1.4.0 version How to solve it

meteorshowers

Object Detection example with TRT7 and TF2.1 issues

10

I'm creating this issue to help collect the issues in the Object Detection example: To start, I have followed the steps and setup the dependencies. Now, attempting to run a...

mankeyboy

Image Classification example with TensorRT 7 and TF 2.1 running into problems

6

Hi everyone, I'm trying to run the Image Classification example with TF 2.0 and TensorRT 7. The changes in the API have now made it that the dependency on NETS...

mankeyboy