ZLUDA CUDA error: CUBLAS_STATUS_NOT

ERROR diffusion_model.output_blocks.5.1.transformer_blocks.1.ff.net.2.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_q.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_k.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_v.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.1.transformer_blocks.1.attn2.to_out.0.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.1.proj_out.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.5.2.conv.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.6.0.in_layers.2.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.6.0.emb_layers.1.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.6.0.out_layers.3.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.6.0.skip_connection.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.7.0.in_layers.2.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.7.0.emb_layers.1.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.7.0.out_layers.3.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.7.0.skip_connection.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.8.0.in_layers.2.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.8.0.emb_layers.1.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.8.0.out_layers.3.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc) ERROR diffusion_model.output_blocks.8.0.skip_connection.weight CUDA error: CUBLAS_STATUS_NOT_SUPPORTED when calling cublasSgemm( handle, opa, opb, m, n, k, &alpha, a, lda, b, ldb, &beta, c, ldc)

Aug 23 '24 22:08 Captain-SeaL

sgemm is already implemented. Please check whether ZLUDA BLAS is loaded and is being used. (cublas.dll on Windows, libcublas.so on Linux)

Aug 24 '24 03:08 lshqqytiger

tasklist /m cublas.dll i write this in cmd if i understood right and it says what can't find it Do I need to replace some dlls in the python libraries?

Aug 24 '24 09:08 Captain-SeaL

What application are you trying?

Aug 24 '24 11:08 lshqqytiger

Fooocus

Aug 24 '24 11:08 Captain-SeaL

Follow the second paragraph of ZLUDA PyTorch instruction.

cublas64_*.dll
cusparse64_*.dll
nvrtc64_*_*.dll

Aug 24 '24 11:08 lshqqytiger

Fooocus

Here you find a install Guide for Fooocus with ZLUDA. I tested it a few minutes ago. https://github.com/CS1o/Stable-Diffusion-Info/wiki/Installation-Guides

Sep 14 '24 21:09 CS1o

Follow the second paragraph of ZLUDA PyTorch instruction.
cublas64_*.dll
cusparse64_*.dll
nvrtc64_*_*.dll

Error loading caffe2_nvrtc.dll or its dependencied after replace the three dll

Nov 15 '24 10:11 HysterLc

Make sure that you have

AMD GPU driver (amdhip64.dll, or amdhip64_6.dll with HIP SDK 6.1)
HIP SDK (rocblas.dll, rocsolver.dll, rocsparse.dll, and hiprtc0601.dll (0507 in HIP SDK 5.7))
Microsoft Visual C Runtime (vcruntime140.dll)

Nov 15 '24 10:11 lshqqytiger

Error loading caffe2_nvrtc.dll or its dependencied after replace the three dll

That error is caused by any Python Version that got installed through the Microsoft Store. To fix it, uninstall all Python Versions you have under the Windows Settings/APPS. Then install Python 3.10.11 64bit with its normal installer from here: https://www.python.org/downloads/release/python-31011/ Check "Add Python to Path" and reboot the System.

Open up a cmd and type python --version and where python

Verify that the Path to Python 3.10.11 is at the top.

Nov 15 '24 13:11 CS1o

Error loading caffe2_nvrtc.dll or its dependencied after replace the three dll

That error is caused by any Python Version that got installed through the Microsoft Store. To fix it, uninstall all Python Versions you have under the Windows Settings/APPS. Then install Python 3.10.11 64bit with its normal installer from here: https://www.python.org/downloads/release/python-31011/ Check "Add Python to Path" and reboot the System.

Open up a cmd and type python --version and where python

Verify that the Path to Python 3.10.11 is at the top.

It's a little better, but new error emerge Error loading "C:\Users\M1175\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\lib\cusolver64_11.dll" or one of its dependencies.

Nov 18 '24 05:11 HysterLc