devalexqt

Looks like it's a BUG in TRT engine.

let me check

For testing I use `nvcr.io/nvidia/tensorflow:21.05-tf2-py3` docker image and `batch=1` and create only one engine for input: `inp1 = tf.random.normal([1,360,640,3])` for testing. Output of your script: ``` Engine name num of...

firefox 52 no luck!

not working

Same shit: ``` ValueError: NodeDef mentions attr 'allow_build_at_runtime' not in Op out_tensor:; attr=serialized_segment:string; attr=segment_func:func,default=[]; attr=InT:list(type),min=1,allowed=[DT_INT8, DT_HALF, DT_FLOAT, DT_INT32]; attr=OutT:list(type),min=1,allowed=[DT_INT8, DT_HALF, DT_FLOAT, DT_INT32]; attr=input_shapes:list(shape),default=[]; attr=max_cached_engines_count:int,default=1; attr=max_batch_size:int,default=1; attr=workspace_size_bytes:int; attr=precision_mode:string,allowed=["FP32", "FP16", "INT8"]; attr=calibration_data:string,default="";...