tf_trt_models
tf_trt_models copied to clipboard
TensorFlow models accelerated with NVIDIA TensorRT
1) Ubuntu 16.04 2) Docker tensorflow/tensorflow 1.13.1 and tensorflow/serving:latest-gpu 3) NVIDIA TensorRT 5.0.2 (https://docs.nvidia.com/deeplearning/sdk/tensorrt-install-guide/index.html) 4) Tensorflow object detection Faster RCNN Resnet101 successfully built w/ 2 classes only 5) Model are...
Hi there, I am using tf_trt_models on jetson NANO with JP 4.2.3, tensorflow 1.14.0. In _detection.py_, there is an entry in "MODEL" dict, **ssd_resnet_50_fpn_coco**. Following the example in detection.ipynb seems...
hi, I got an error when running this code line: import tensorflow.contrib.tensorrt as trt can you tell me how to slove this?
I found that we can optimize the Tensorflow model in several ways. If I am mistaken, please tell me. 1- Using [TF-TRT](https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html) This API developer by tensorflow and integreted TensoRT...
Hi, I use example/classification/classification.ipynb by inceptionV3 model on Jetson AGX Xavier. I modify it to print inference time by "import datetime" as following: ``` ...... tf.import_graph_def(trt_graph, name='') tf_input = tf_sess.graph.get_tensor_by_name(input_names[0]...
Hi, Any guess on why I only have 8 FPS while you have twice on a TX2 ? I'm working with tensorflow 1.15.2, TensorRT 6 (Jetpack 4.3) Thanks ! :)
I'm trying to optimize the model on a Jetson Nano device in precision mode FP16. I run into out of memory problem and the process crashes. Any ideas how to...
AttributeError: 'PostProcessing' object has no attribute 'score_threshold' the pipeline.config file downloaded from your code has `score_threshold` inside `batch_non_max_suppression` block