Taige Wang comments

Repositories
Issues
Comments

Results 1 comments of


                                            Taige Wang

AutoModelForCausalLM.from_pretrained(.., gpu_layers=..) gives Windows Error 0xc000001d

~~Same issue here. Windows 11, Cuda 11.8/12.3, Python 3.12/3.11, model `llama-2-13b-chat.Q8_0.gguf`, same output.~~ Update: Got it fixed. It turns out that my CPU does not support AVX2, so I cloned...