llama-cpp-python
llama-cpp-python copied to clipboard
Access Violation issue facing for exe created using pyinstaller
I am trying to create a executable for one of the python script. When I try to run the application created using pyinstaller I am getting an error while trying to load the model using llama_cpp
ValueError: Could not load Llama model from path: ... Received error exception: access violation reading 0x0000000000000000
If I run the same application directly from pycharm its working fine but I face this issue only when I try to run the executable.
I have exactly the same issue. @maniron214 did you find a solution yet?
I was also struggling with the same issue and ran the .exe file through a stack trace. The results showed an error occurring when calling MSVCP140.dll. Therefore, I used the “--add-data” command to embed this DLL and the DLLs related to llama_cpp_python into the exe. This resolved the problem, and I obtained the same results as when running the .py file. This comment was generated by AI translation, so I apologize if it's hard to read.