OnCodeDeny comments

Repositories
Issues
Comments

Results 2 comments of


                                            OnCodeDeny

Trying to load llm model using llama cpp python with GPU support fails with an OSError: exception: access violation reading 0x0000000000000000

Windows 10 Python 3.10.11 Running in Python venv Using llama.cpp locally built with OpenBLAS llama_cpp_python 0.3.16 Got this: File "C:\MyProject\venv\lib\site-packages\llama_cpp\llama.py", line 2361, in from_pretrained return cls( File "C:\MyProject\venv\lib\site-packages\llama_cpp\llama.py", line 206,...

Trying to load llm model using llama cpp python with GPU support fails with an OSError: exception: access violation reading 0x0000000000000000

> Windows 10 Python 3.10.11 Running in Python venv Using llama.cpp locally built with OpenBLAS llama_cpp_python 0.3.16 > > Got this: File "C:\MyProject\venv\lib\site-packages\llama_cpp\llama.py", line 2361, in from_pretrained return cls( File...