onnx-tensorrt icon indicating copy to clipboard operation
onnx-tensorrt copied to clipboard

requires bool I/O but node can not be handled by Myelin.

Open ioir123ju opened this issue 2 years ago • 4 comments

operators.md error. Tensorrt8.2 does not support bool value. Correlation operators are also not supported. For example:slice requires bool I/O but node can not be handled by Myelin. What should we do with bool value?

ioir123ju avatar Apr 21 '22 05:04 ioir123ju

i also meet the same problem: [TRT] [E] 2: [myelinBuilderUtils.cpp::operator()::293] Error Code 2: Internal Error (Slice_79requires bool I/O but node can not be handled by Myelin.)

dahaogewsh avatar May 03 '22 06:05 dahaogewsh

TRT 8.2 should be handle BOOL slices properly. Are you able to share the ONNX model that's encountering this error?

kevinch-nv avatar May 12 '22 22:05 kevinch-nv

@kevinch-nv

In my case, also shows. it occurs in https://catalog.ngc.nvidia.com/orgs/nvidia/containers/tensorrt

I've tested with 22.01 ~ 22.06

My model was failed in 22.05, 22.06, but got success in 22.01, 22.02. 22.03, 22.04, Following Supporting Matrix, tensorrt 8.2.5 has a problem in parsing onnx.

[07/13/2022-07:47:16] [E] Error[2]: [myelinBuilderUtils.cpp::operator()::293] Error Code 2: Internal Error (Expand_2447requires bool I/O but node can not be handled by Myelin.)

kimdwkimdw avatar Jul 13 '22 07:07 kimdwkimdw

Slice_79requires bool I/O but node can not be handled by Myelin.)

In my case, torch boolean (i.e. typically an output of NOT node) is treated as INT64 in ONNX so that Myelin can't handle (dynamic input). Hence the solution is manually adding a cast node after that. Also see https://forums.developer.nvidia.com/t/requires-bool-i-o-but-node-can-not-be-handled-by-myelin/212076

serser avatar Apr 26 '23 14:04 serser