Pooya Davoodi

I think TRT will fallback to fp32 in case int8 is not supported for a layer/plugin. In general, you shouldn't worry about if some ops aren't supported in int8 because...

> @pooyadavoodi > > Thank you for your reply. When I tried using TrtGraphConverterV2, I got this error in Int8 mode: > > ``` > E tensorflow/core/common_runtime/executor.cc:654] Executor failed to...

TF-TRT currently doesn't support loops, control ops, or TensorArray. TensorRT also doesn't support them at the moment. We have observed that a much more efficient way of doing NMS in...

Supporting while_loop in TF-TRT is not planned yet. TensorRT itself also doesn't support loops or control ops yet. Currently, if you optimize your model with TF-TRT, the while_loop would stay...

+@aaroey I'm not sure what version of TF-TRT the saved_model_cli would use. I suppose the latest from master. Looks like there are two problems we need to look at: -...

If you use TF1.14, you should get some speedup. Please make sure you use the same TF-TRT API that is used in the examples in this repository.

This repository is not for UFF (it's only for TF-TRT). Please report this failure in https://devtalk.nvidia.com/default/board/304/tensorrt/