ctransformers Remove GGML_USE_CUBLAS when CT

Hi,

I couldn't install the library with HIPBLAS because of missing CUDA stuff. Turns out there was an extra option for compiling with CUBLAS when CT_HIPBLAS is defined.

Also, should fix #134 and #135

Sep 17 '23 14:09 muaiyadh

Trying this myself, it seems to work, thank you!

Sep 17 '23 20:09 bugfixin

Still does not build for me. However, the log is now significant shorter. https://gist.github.com/CrashTD/e3ef7d4901a22b7795e1618b196e3d36

maybe just a incompatibility with the still relatively new gfx1101?

Sep 18 '23 10:09 CrashTD

Still does not build for me. However, the log is now significant shorter. https://gist.github.com/CrashTD/e3ef7d4901a22b7795e1618b196e3d36

maybe just a incompatibility with the still relatively new gfx1101?

It looks like your compilation is using the standard system compilers (cc and c++), try setting the environment variables CC="/opt/rocm/llvm/bin/clang" CXX="/opt/rocm/llvm/bin/clang++" (you can prepend that to the pip install command), e.g. CC="/opt/rocm/llvm/bin/clang" CXX="/opt/rocm/llvm/bin/clang++" CT_HIPBLAS=1 pip install ctransformers --no-binary ctransformers

Sep 18 '23 19:09 bugfixin

It looks like your compilation is using the standard system compilers (cc and c++), ...

That in combination with the removal of the CUBLAS line fixed it. Thanks a lot!

Sep 19 '23 11:09 CrashTD

Remove GGML_USE_CUBLAS when CT_HIPBLAS is defined