Error searching for cublasHgemmStridedBatched

[jafioti]

I get an error when compiling. I am on CUDA 12.2:

undefined reference to `cublasHgemmStridedBatched'
          collect2: error: ld returned 1 exit status
          
  = note: some `extern` functions couldn't be found; some native libraries may need to be installed or have their path specified
  = note: use the `-l` flag to specify native libraries to link
  = note: use the `cargo:rustc-link-lib` directive to specify the native libraries to link with Cargo (see https://doc.rust-lang.org/cargo/reference/build-scripts.html#cargorustc-link-libkindname)

[coreylowman]

I'm not getting this issue on my end. Can you send over feature flags you are using?

[jafioti]

I am using "f16" and "cuda-version-from-build-system" flags

note: /usr/bin/ld: /home/jafioti/Documents/luminal/crates/luminal_cuda/target/debug/deps/libcudarc-ecd7f89b2d31ef4e.rlib(cudarc-ecd7f89b2d31ef4e.cudarc.eb609baea378fa4b-cgu.12.rcgu.o): in function cudarc::cublas::result::hgemm_strided_batched': /home/jafioti/.cargo/registry/src/index.crates.io-6f17d22bba15001f/cudarc-0.11.0/src/cublas/result.rs:242: undefined reference to cublasHgemmStridedBatched' collect2: error: ld returned 1 exit status

[newfla]

Hi, I can confirm that the same issue occurs compiling candle. See https://github.com/huggingface/candle/issues/1882