TensorRT issue on RTX5090

Open blademeng opened this issue 9 months ago • 16 comments

Hi, Downloaded the latest v1.15.3 katago. OpenCL works fine. Latest NVIDIA driver. But when I try to use TensorRT, it shows as below issue:

Running quick initial benchmark at 16 threads! 2025-03-29 06:54:25+0800: nnRandSeed0 = 5406967903729009098 2025-03-29 06:54:25+0800: After dedups: nnModelFile0 = ..\katago_weights\b28c512nbt.bin.gz useFP16 auto useNHWC auto 2025-03-29 06:54:25+0800: Initializing neural net buffer to be size 19 * 19 exactly 2025-03-29 06:54:27+0800: TensorRT backend thread 0: Found GPU NVIDIA GeForce RTX 5090 memory 34190458880 compute capability major 12 minor 0 2025-03-29 06:54:27+0800: TensorRT backend thread 0: Initializing (may take a long time) 2025-03-29 06:54:35+0800: Creating new timing cache 2025-03-29 06:54:35+0800: TensorRT backend: 2: [helpers.h::nvinfer1::smVerHex2Dig::694] Error Code 2: Internal Error (Assertion major >= 0 && major < 10 failed. )

Tried both trt8.6.1-cuda12.1 and trt10.2.0-cuda12.5. Not sure why. I also tried the old verstion katago v1.14.0-trt8.6.1-cuda12.1, not work too.

Please help to look into this. Maybe it is something regard to my setup.

Mar 28 '25 22:03 blademeng