error when build TensorRT_LLM engine

[zxy1119]

System Info

CUDA 11.8 Please tell me what causes this error.

Who can help?

No response

Information

• [ ] The official example scripts
• [ ] My own modified scripts

Tasks

• [ ] An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• [ ] My own task or dataset (give details below)

Reproduction

python scripts/build_wheel.py --clean --trt_root /data0/baolili/TensorRT-10.1.0.27 --python_bindings --benchmarks

Expected behavior

Successfully built tensor_llm

actual behavior

Failed to build

additional notes

Failed to build

[Kefeng-Duan]

Hi, @zxy1119 Which GPU are you using?

[zxy1119]

@Kefeng-Duan nvidia A800 i upgraded CUDA version 11.8 -> 12.2 but still build tensorrt_llm error

[Kefeng-Duan]

@zxy1119 have you clean the workspace?

[zxy1119]

i use python3 scripts/build_wheel.py --clean --trt_root /usr/local/TensorRT-10.1.0.27,but and it is no *.whl file generated in the directory cpp/build. how to clean the workspace?

[Kefeng-Duan]

@zxy1119 could you update to the latest version, delete the build folder and rerun the build wheel command?

[zxy1119]

it is the latest version , and i think the problem is cutlass_kernels

this is my version

[Kefeng-Duan]

@zxy1119 could you show more screenshot about the cutlass error?

[zxy1119]

sure, this is my build log cmake_log.log

[zxy1119]

This part of the code seems to be the issue.

[yuhengxnv]

@zxy1119 GCC 8 seems too old, please try with a newer GCC. I tested and failed with 8.3, succeeded with 12.2, FYI.

[github-actions[bot]]

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 15 days."

[poweiw]

@zxy1119 any updates after trying https://github.com/NVIDIA/TensorRT-LLM/issues/2124#issuecomment-2308950182?

[github-actions[bot]]

Issue has not received an update in over 14 days. Adding stale label.

[github-actions[bot]]

This issue was closed because it has been 14 days without activity since it has been marked as stale.