Chad Canning comments

Repositories
Issues
Comments

Results 2 comments of


                                            Chad Canning

torch version is too old

newest version of torch works fine here.

Cannot build with CUDA on Win11

im not sure why it isnt being fixed, but this worked for me: https://github.com/abetlen/llama-cpp-python/discussions/871 `set "CMAKE_ARGS=-DLLAMA_CUBLAS=on" && pip install llama-cpp-python`