mcglynnfinn comments

Repositories
Issues
Comments

Results 1 comments of


                                            mcglynnfinn

Models loading on CPU instead of GPU after updating version

Having exact same issue but if I go above 0.3.4 What CUDA are you using and are you using pre-made wheel using https://abetlen.github.io/llama-cpp-python/whl/ for example?