Performance considerations - using TensorRT?

[mindThomas]

It seems like you are not using TensorRT for inference? Wouldn't you be able to get better performance by using TensorRT rather than Keras for inference? What is the current performance / FPS achievable with your network running on the Jetson?

[aayalur-nv]

We were able to get around 4-5 hz for inference, sometimes a bit less. TensorRT would ideally make it a lot better, but for our purposes we thought that keras would make our concat network more modular and easier for us and other viewers to understand.