KrisN comments

Repositories
Issues
Comments

Results 2 comments of


                                            KrisN

The NPU version of llama.cpp did not return an appropriate response on Intel Core Ultra 7 268V

Same problem here when I use DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf model. Interestingly, the garbled output issue doesn't seem to happen on DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf CPU: Intel Core Ultra 7 258V NPU Driver: 32.0.100.3764 (from device...

The NPU version of llama.cpp did not return an appropriate response on Intel Core Ultra 7 268V

> > Same problem here when I use DeepSeek-R1-Distill-Qwen-7B-Q6_K.gguf model. > > Interestingly, the garbled output issue doesn't seem to happen on DeepSeek-R1-Distill-Qwen-1.5B-Q4_K_M.gguf > > CPU: Intel Core Ultra 7...