onnx-tensorrt
onnx-tensorrt copied to clipboard
requires bool I/O but node can not be handled by Myelin.
operators.md error. Tensorrt8.2 does not support bool value. Correlation operators are also not supported. For example:slice requires bool I/O but node can not be handled by Myelin. What should we do with bool value?
i also meet the same problem: [TRT] [E] 2: [myelinBuilderUtils.cpp::operator()::293] Error Code 2: Internal Error (Slice_79requires bool I/O but node can not be handled by Myelin.)
TRT 8.2 should be handle BOOL slices properly. Are you able to share the ONNX model that's encountering this error?
@kevinch-nv
In my case, also shows. it occurs in https://catalog.ngc.nvidia.com/orgs/nvidia/containers/tensorrt
I've tested with 22.01 ~ 22.06
My model was failed in 22.05, 22.06, but got success in 22.01, 22.02. 22.03, 22.04, Following Supporting Matrix, tensorrt 8.2.5 has a problem in parsing onnx.
[07/13/2022-07:47:16] [E] Error[2]: [myelinBuilderUtils.cpp::operator()::293] Error Code 2: Internal Error (Expand_2447requires bool I/O but node can not be handled by Myelin.)
Slice_79requires bool I/O but node can not be handled by Myelin.)
In my case, torch boolean (i.e. typically an output of NOT node) is treated as INT64 in ONNX so that Myelin can't handle (dynamic input). Hence the solution is manually adding a cast node after that. Also see https://forums.developer.nvidia.com/t/requires-bool-i-o-but-node-can-not-be-handled-by-myelin/212076