tvm icon indicating copy to clipboard operation
tvm copied to clipboard

[Bug] [CUDA] not compilable with CUDA 11.4 due to missing symbols

Open punktphil opened this issue 8 months ago • 0 comments

TVM is not compilable with CUDA 11.4 due to missing symbols CUDA_R_8F_E4M3 and CUBLASLT_MATMUL_DESC_A_SCALE_POINTER (Which have been introduced in CUDA 12.x afaik)

Expected behavior

successful compile

Actual behavior

406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:169:15: error: 'CUDA_R_8F_E4M3' was not declared in this scope
406.2   169 |     ab_type = CUDA_R_8F_E4M3;
406.2       |               ^~~~~~~~~~~~~~
406.2 In file included from /opt/tvm/src/runtime/contrib/cublas/cublas.cc:29:
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:199:64: error: 'CUBLASLT_MATMUL_DESC_A_SCALE_POINTER' was not declared in this scope; did you mean 'CUBLASLT_MATMUL_DESC_BIAS_POINTER'?
406.2   199 |     CHECK_CUBLAS_ERROR(cublasLtMatmulDescSetAttribute(op_desc, CUBLASLT_MATMUL_DESC_A_SCALE_POINTER,
406.2       |                                                                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas_utils.h:69:34: note: in definition of macro 'CHECK_CUBLAS_ERROR'
406.2    69 |     int error = static_cast<int>(fn);                                                     \
406.2       |                                  ^~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas.cc:204:64: error: 'CUBLASLT_MATMUL_DESC_B_SCALE_POINTER' was not declared in this scope; did you mean 'CUBLASLT_MATMUL_DESC_BIAS_POINTER'?
406.2   204 |     CHECK_CUBLAS_ERROR(cublasLtMatmulDescSetAttribute(op_desc, CUBLASLT_MATMUL_DESC_B_SCALE_POINTER,
406.2       |                                                                ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
406.2 /opt/tvm/src/runtime/contrib/cublas/cublas_utils.h:69:34: note: in definition of macro 'CHECK_CUBLAS_ERROR'

406.2 69 | int error = static_cast(fn);

Environment

should not really matter, but: Ubuntu 20.04 in docker (x86_64) CUDA 11.4

  • needs-triage

punktphil avatar Mar 21 '25 08:03 punktphil