Dibakar Gope comments

Repositories
Issues
Comments

Results 2 comments of


                                            Dibakar Gope

Bug: ggml-aarch64.c does not compile on Windows ARM64 with MSVC

For clang, to use the aarch64 optimized kernels for Q4_0 from ggml-aarch64.c, we need to first convert (requantize) Q4_0.gguf to Q4_0_4_8.gguf (or Q4_0_4_4.gguf) before using a cli. I am not...

Improvements for running on Windows with Snapdragon X

The conditional seems to be fine for now, I will confirm it shortly.