Darx Kies

Support for GGML BLAS

1

It would be great if BLAS could be enabled in GGML by the user. Enabling BLAS does significantly enhance the performance of GGML. I have tested llama.cpp/GGML with cublas, and...

Extend ggml format to include a description of the model.

14

On Hugging Face there are many files called ggml-model-f16.bin or similar. Once downloaded the user can rename them. The information about its origin gets lost. Updating the file becomes difficult...

Does not compile

2

Hi I am getting the following error. github.com/docker/go-plugins-helpers/sdk/unix_listener.go:20: cannot use gid (type int) as type string in argument to sockets.NewUnixSocket That is due to the fact that I stick to...