Daniele

I have two 4 bit models but the commit didn't fix the gibberish responses

A straight forward fix could be the removal of the video cards whenever the swipe controls are enabled in the settings

I'm sorry to disappoint you but openblas doesn't use the gpu to accelerate the processing but it uses the cpu itself. If anything you should try DGGML-CLBLAST=ON in order to...

I'm no expert in opencl but it will require some time, it's not just a copy/paste. The good news is that with the current ram usage the gpu acceleration will...

As I told you I don't know a lot about how the OpenCL implementation works but you probably have to implement each computing kernel of the stock cpu code in...

Is there any specific configuration to make it work? I built it with HIPBLAS and CUBLAS but it doesn't seem to work

I'm on Arch using a Radeon 5700XT. The problem is that the program doesn't use the GPU at all. The compilation works as expected and I have every hip and...

Nope, 0

Nevermind, I rebuilt it correctly with make -j8 LLAMA_HIPBLAS=1 and the program reports BLAS=1 however the gpu isn't used at all

Still 0 GPU usage