tkDNN icon indicating copy to clipboard operation
tkDNN copied to clipboard

Performance Issues on Jetson Xavier NX

Open MsWik opened this issue 3 years ago • 4 comments

CV 4.5.0 + CUDA, jetpack 4.5.1. Low performance of models like yolo4, yolo4x (lower than in the original darcnet), performance of tiny models is correct. Also, when I try to convention any model in INT8, I get the following error: failed to open  /home/andry/test_jetson_xavier/tkDNN-master/tkDNN/src/Int8BatchStream.cpp:69 Aborting...

MsWik avatar May 19 '21 05:05 MsWik

Regarding the int8 model conversion ,have you downloaded the dataset and followed the steps mentioned in the Readme? Cause it looks there is a problem with your dataFilePath for image paths

And about the low performance on Xavier nx ...are you using the current master branch ?

perseusdg avatar May 19 '21 06:05 perseusdg

FP16 / FP32 dimension models are obtained correctly, the error occurs only when I use INT8. yes, the current master branch is used

MsWik avatar May 19 '21 09:05 MsWik

Yolo 4, yolo 4x performance issue resolved by reinstalling tkDNN, int8 issue not resolved yet.

MsWik avatar May 19 '21 11:05 MsWik

@MsWik have you downloaded the dataset as suggested by @perseusdg ? Have you exported the needed env variables as explained here?

I tested everything yesterday on a Jetson Xavier AGX and I got no problems.

mive93 avatar Nov 25 '21 10:11 mive93