Ryan McCormick

Hi @Hassan313 , If you change the ONNX parser code to use Caffe parser instead: * https://github.com/rmccorm4/tensorrt-utils/blob/8dcd18c5c88f35bdb04e42e46b46862d81c36230/classification/imagenet/onnx_to_tensorrt.py#L79 * https://github.com/rmccorm4/tensorrt-utils/blob/8dcd18c5c88f35bdb04e42e46b46862d81c36230/classification/imagenet/onnx_to_tensorrt.py#L116-L122 I believe you should be able to use the INT8 code...

Hi @Hassan313 , Per the error, it looks like you're still using the ONNX parser. Did you change the code to use the Caffe parser as suggested above?

If you're actually using an ONNX model and are using TensorRT >= 7.0, you'll need to add the `--explicit-batch` flag when running the script. The README instructions are a little...

FYI that infer_tensorrt script is **definitely** out of date for TensorRT 7 ONNX models. Since the EXPLICIT_BATCH flag is used, the batch size dimension of the original ONNX model will...

This is just a python syntax error, not specific to TensorRT. Looks like you're missing a parentheses at the end of `network.mark_output(model_tensors.find("prob"))`

I believe the Caffe parser uses a different syntax than the ONNX parser used here: https://www.github.com/rmccorm4/tensorrt-utils/tree/8dcd18c5c88f35bdb04e42e46b46862d81c36230/classification%2Fimagenet%2Fonnx_to_tensorrt.py Although I notice you have some Caffe parser code in your snippet above, so...

I'm not sure if there is an automatic way to fix that (i.e. let parser correctly name all layers). I'm not sure why that happens. It's probably when there's no...

Hi @Hassan313 , Not too sure. You'll probably have to do a bit of investigation to see how the 2 files correlate. Maybe try creating a few caches, see if...

Hi @maidmentdaniel , The int8 code in this repo is pretty outdated - I would encourage you to refer to Polygraphy's INT8 sample. The API is very intuitive to use:...

What version are you currently running? Also, the tensorrt NGC containers are a good way of trying different versions without always having to update host dependencies: https://ngc.nvidia.com/containers/nvidia:tensorrt