tensorrt
tensorrt copied to clipboard
tensorflow
TensorFlow/TensorRT integration
Hi, I am trying to run `object_detection.py` from `tftrt/examples/object_detection` but I get out-of-memory even on a powerful Nvidia RTX 2080 Ti (with 11GB memory). I tried with 3 different models...
I want to run facenet in jetson xavier nx. So there is a placeholder node which name is 'input', i used tf-trt (nvidia-tensorflow1.15) to convert frozen_graph to uff, the 'input'...
Hi, I use the code to convert my yolov3 to FP16. the converted model is faster. but when convert my yolov3 model to INT8-trt, it throw an core dumped error....
I was trying to run the following notebook on Ubuntu 18.04 with T4 GPU on EC2, https://github.com/tensorflow/tensorrt/blob/master/tftrt/examples/image-classification/TFv2-TF-TRT-inference-from-Keras-saved-model.ipynb I can run most cells until *TF-TRT FP32 model* section, the kernel will...
Currently, the examples show how to go from a SavedModel to a graph function (`get_func_from_saved_model`) and do basic inference. However, for production environments, I could image that you'd want to...
The following is sample from[ tftrt link](https://docs.nvidia.com/deeplearning/frameworks/tf-trt-user-guide/index.html) for tftrt code for frozen graph. ``` import tensorflow as tf from tensorflow.python.compiler.tensorrt import trt_convert as trt with tf.Session() as sess: # First...
Hello, I am working on object detection with tensorflow 1.14. I have the following training pipeline: - training SSD mobilenet inception v2 300x300 on my custom dataset using the object...
Hi, I have a quite large model (140MB weights) that, that was successfully converted to TRT with TF 2.1.0 But with 2.2.0 rc1,rc2,rc3 it always fails with following message `...
Hello all, I have some troubles optimizing an object detector (SSD) with custom bounding box decoder. It works well when running it with TF2 but I get a SEGFAULT when...
